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Abstract 


In this thesis, we review and examine the replica method from several viewpoints. The 
replica method is a mathematical technique to calculate general moments of stochastic 
variables. This method provides a systematic way to evaluate physical quantities and 
becomes one of the most important tools in the theory of spin glasses and in the related 
discipline including information processing tasks. 

In spite of the effectiveness of the replica method, it is known that several problems 
exist in the procedures of the method itself. The replica symmetry breaking is the central 
topic of those problems and is the main issue of this thesis. To elucidate this point, we 
first review the recent progress about the replica symmetry breaking including its physical 
and mathematical descriptions in detail. 

Second, we accept the recent descriptions of the replica symmetry breaking and inves¬ 
tigate the Ising perceptron, which is a model of a neuron, by intensively utilizing those 
descriptions, to examine the consequence of the replica symmetry breaking. Our result 
is consistent to the replica symmetry breaking description, but shows that the replica 
method cannot correctly describe the phase-space structure of this system. This is be¬ 
cause the phase space of this system constitutes an exceptional structure which violates 
the usual assumption of the replica method, but it is also explained that this problem is 
not directly related to the replica symmetry breaking itself. 

Next, without employing the replica symmetry breaking, we investigate the zeros of 
the averaged nth moment of the partition function with respect to the complex replica 
number n for the purpose of investigating the analyticity breaking of the generating 
function, which is related to the replica symmetry breaking, appearing in the replica 
procedures. For this purpose, we employ the ± J model on some tree systems and ladders. 
Our result implies that the zeros actually signal a certain kind of analyticity breaking, 
but is irrelevant to any replica symmetry breaking. 

To investigate the origin of the irrelevance of zeros of the nth moment to the replica 
symmetry breaking, we finally study the partition function zeros with respect to the exter¬ 
nal field and temperature for the tree systems. The result shows that the two dimensional 
part of the zeros density continuously touches the real axis in a certain range of the objec¬ 
tive parameters. This result implies that the invisibility of the replica symmetry breaking 
by the previous formulation is not due to the peculiarity of the tree systems but due to 
the problem of the formulation itself. Another interesting implication of the result is that 
it leads to the instability of the system against deviations with respect to the external 
held and temperature in the spin-glass phase. This is the first direct evidence that the 
system shows singular behavior in the spin-glass phase. 

The above results reveal several aspects and problems of the replica method and 
contribute to underpinning this method and the mean-held theory of spin glasses, which 
consequently inspire future study and understanding of spin glasses and the related topics. 


Acknowledgment 


First of all, I would like to express my sincerest gratitude to my supervisor, Professor 
Hidetoshi Nishimori for his guidance, continuous encouragements and spiritual support. 
I also greatly acknowledge Professor Yoshiyuki Kabashima for his guidance, fruitful dis¬ 
cussions and collaborations on my studies. 

I express my gratitude to the members of the Nishimori group and the condensed 
matter theory group of Tokyo Institute of Technology for stimulating discussions and 
warm atmosphere by them. Especially, Yoshiki Matsuda kindly taught me some technical 
details of numerical calculations and I am particularly appreciative of him. 

I also thank Doctor Antonello Scardicchio, Doctor Markus Muller, and Professor Fed¬ 
erico Ricci-Tersenghi for fruitful discussions and kindness when I visited Italy for research 
collaborations. Professor Eric Vincent kindly taught me some experimental properties of 
spin glasses and discussed my studies. I am also grateful to him. 

This work was supported by the Japan Society for the Promotion of Science (JSPS) 
Research Fellowship for Young Scientists program, CREST(JST), the 21th Century COE 
Program ‘Nanometer-Scale Quantum Physics’ and the Global COE Program ‘Nanoscience 
and Quantum Physics’ at Tokyo Institute of Technology, and by the Grant-in-Aid for Sci¬ 
entific Research on the Priority Area “Deepening and Expansion of Statistical Mechanical 
Informatics” by the Ministry of Education, Culture, Sports, Science and Technology. A 
portion of the numerical calculations have been performed on the TSUBAME Grid Clus¬ 
ter at the Global Scientific Information and Computing Center (GSIC), Tokyo Institute 
of Technology. 

Finally, I thank my family for spiritual support. 


3 


Contents 


1 Introduction 

1.1 Spin glasses. 

1.2 Mean-field theory. 

1.3 Pure state and its implications. 

1.3.1 A simple introduction to the concept of pure states. 

1.3.2 Relations between pure states and dynamical behaviors . . . 

1.3.3 Hierarchical structure of pure states in the mean-held model 

1.3.4 Experimental supports of the hierarchical structure. 

1.3.5 The mean-held theory and more. 

1.4 The replica method. 

1.5 Overview of thesis. 


7 

_E 

10 

n 

n 

12 

13 

17 

19 

■K) 

22 


2 Review of the replica method and its interpretations 

2.1 Replica calculations for the fully-connected p-spin interacting model . . . . 

2.1.1 Replica symmetric ansatz . 

2.2 The solution in the limit p —> oo . 

2.2.1 Failure of the RS solution. 

2.2.2 Microcanonical approach. 

2.3 Replica symmetry breaking . 

2.3.1 The 1RSB solution for the p-spin interacting model. 

2.3.2 The 1RSB solution in the p —>■ oo limit. 

2.4 Pure state statistics of the 1RSB level. 

2.4.1 Pure states of the limit p —>• oo . 

2.5 Viewpoint from the large deviation theory. 

2.5.1 Re-derivation of the 1RSB transition. 

2.6 Finite p cases. 

2.6.1 de Almeida-Thouless instability. 

2.6.2 Phase diagrams for the p = 2,3 cases. 

2.7 Microscopic description of pure states. 

2.7.1 TAP method . 

2.7.2 Zero temperature limit. 

2.8 Summary . 


[25 

25 

27 

29 

29 

29 

32 

33 

34 

35 
37 

39 

40 
43 
43 
49 
51 
51 

53 

54 


4 




































3 


Analyses of weight space structure and rare events in the Ising percep- 
tron 

3.1 Model. 

3.2 Formalism. 

3.2.1 The replica symmetric solution . 

3.2.2 The 1RSB solution. 

3.2.3 The complexity and 1RSB formulation revisited. 

3.3 Theoretical predictions . 

3.3.1 Complexity for a < a s = 0.833. 

3.3.2 Rate function for a > a s = 0.833... and a transition at «gd = 

1.245. 

3.3.3 Phase diagram on the n-a plane. 

3.4 Numerical validation. 

3.5 Summary . 


55 

56 

57 

58 

59 
61 
64 
64 


65 

67 

68 
72 


4 The replica zeros of ±J Ising spin glass at zero temperature 

4.1 Fundamental knowledge about models and formulations. 

4.1.1 Definition of the Cayley tree and the properties. 

4.1.2 Bulk properties of Cayley trees . 

4.1.3 Zeros and singularities. 

4.1.4 Energetic zero-temperature limit for replica zeros . . . . 

4.2 General formula for ladders and Cayley trees. 

4.2.1 The cavity method. 

4.2.2 Use of the replica method. 

4.2.3 Energetic zero-temperature limit in the cavity recursions 

4.2.4 Uniqueness of the analytic continuation. 

4.3 Results for the ladders. 

4.4 Results for the CTs. 

4.4.1 Plots of the replica zeros for CTs. 

4.4.2 The thermodynamic limit and phase transitions of BLs , 

4.4.3 Possibility of the full-step replica symmetry breaking . . 

4.4.4 Physical implications of the obtained solutions. 

4.5 RZs for RRGs. 

4.6 Summary . 


|T4 

75 

75 

78 

80 

21 

82 

82 

84 

86 

89 

89 

91 

91 

92 
_98 
101 

102 

102 


5 


The replica symmetry breaking and the partition function zeros for 


Bethe lattice spin glasses 

5.1 Phase boundaries and critical properties of Bethe lattice spin glasses . . . . 

5.2 Formulations . 


5.2.1 The partition function zeros of Bethe lattices 

5.2.2 Population method to evaluate the CFD . . 

5.2.3 Numerical procedures. 


104 

105 

107 

107 

109 

111 


5 























































5.3 Result. 

5.3.1 Zeros on the complex field plane. 

5.3.2 Zeros on the complex temperature plane . . 

5.3.3 Phase diagram . 

5.3.4 The divergence of the spin-glass susceptibility 

5.4 Summary . 


11 2 

112 

III 

115 

116 

118 


6 Conclusion 


120 


A Calculations for chapter 3 

A.l Derivation of the RS saddle-point equations and the limit q —» 1. 

A.2 Derivation of the AT condition. 

A.2.1 AT instability of the RS2 solution. 


124 

1 2-1 

125 

129 


B 


Calculations for chapter 4 

B.l Derivation of the generating function <f>(n) and free energy of regular ran¬ 
dom graphs . 

B.2 Location of replica zeros of the width-2 ladder. 

B.3 Rate function for a CT with c = 3. 

B.4 AT condition for the (k, c ) = (2, 3) Bethe lattice. 


131 


131 

135 

137 

137 


C Calculations for chapter 5 

C.l Divergence point of the spin-glass susceptibility at zero temperature 


141 

141 


6 








































Chapter 1 
Introduction 


Random spin systems are one of the major research subjects in statistical physics. The 
spatial randomness of conflicting interactions introduces random frustration into the sys¬ 
tem. The frustration can produce many metastable states and the system becomes af¬ 
fected by such states. If the structure of the metastable states is highly complex, the sys¬ 
tem shows strange behaviors like the extraordinary susceptibility against external fields, 
the extremely slow dynamics, and so on. Spin systems with such behaviors are called spin 
glasses. 

At present time, one of the most important progresses of the theory of spin glasses is 
its mean-field description. The mean-field theory is constructed by several mathematical 
tools. The replica method is one of the most powerful tools and the main purpose of 
this thesis is to review and examine this method. Because of the intricacy of the replica 
theory, there still remain many problems in the theory itself. We review recent progress 
about this topic and provide some new approaches to reveal the mysteries related to the 
replica method. Before going into the details, we start with reviewing histories and topics 
on spin glasses and related subjects. 

1.1 Spin glasses 

A simple description of spin glasses is by its low temperature state. For ferro and anti-ferro 
magnets, the low temperature states are uniform or periodic, but those of spin glasses 
are spatially disordered and frozen ones. The existence of such states usually needs two 
requirements; one is the existence of competing interactions among spins which leads 
to no single configuration favored by all the interactions (this is called the frustration). 
Second is the spatial randomness of the interactions, which is necessary for disordered 
configurations stable at low temperatures. 

Experimentally, materials satisfying the above two requirements are found in several 
alloys consisting of noble metals (Au, Ag, Cu, etc.) weakly diluted with transition metals 
(Fe, Mn, etc.). Interactions between the moments of the impurity atoms (spins) effectively 
appear through the interactions with the conducting electrons. The effective interaction 
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is called the RKKY interaction [UEj 


Jij oc — cos(2kprij), (1.1) 

r ij 

where r i3 is the distance between two impurity atoms and kp is the Fermi wave number. 
The RKKY interaction takes both positive and negative values of J i3 due to randomness 
in the position of impurities and random frustration is introduced between the localized 
spins. 

One of the important problems is how to characterize these disordered frozen states. 
To characterize a ferromagnetic state, the averaged magnetization m = (JY (Si))/N is 
sufficient, where the brackets (• • •) denote the thermal average over the Boltzmann factor 
exp(—and i denotes the site index, and /? is the inverse temperature (3 = 1/T, where 
we put the Boltzmann constant to unity kp — 1. Meanwhile, to precisely describe the 
disordered frozen states, more detailed information about the local spontaneous magne¬ 
tization rrii = (Si) is required. If the spin-glass phase exists, the characteristic property 
that spins randomly freeze should be reflected in that phase. The local magnetization 
rrii = (Si) is expected to take a non-zero value in such a situation but the sign is ran¬ 
domly distributed from site to site, which implies that the global magnetization vanishes 
m = (JY (Si))/N = 0. Hence, to detect the spin-glass ordering, the square value of the 
local magnetization m\ is useful. This speculation leads to an order parameter q defined 
as 

« = (L2) 
i 

This quantity q was first introduced by Edwards and Anderson [3] and is called the spin- 
glass order parameter. The disordered frozen phase at low temperatures is called the 
spin-glass phase and is characterized by m = 0, q > 0, while the paramagnetic phase has 
m = q = 0 and the ferromagnetic phase is characterized by m, q > 0. 

In a ferromagnet, the ferromagnetic phase transition is accompanied by a rapid increase 
of the spin-correlation length which diverges at the critical temperature. This can be 
observed in the divergence of the linear susceptibility \ 


X dm(H) 1 x - drrii 
P = d(pH) = N^ d(Phj) 


i,j i,j 


(1.3) 


where h 3 denotes the local held applied to the site j. For the spin-glass problem we can 
also expect a similar phenomenon coming from the spin-glass ordering, but the simple 
spin-correlation function Xij does not show the long range correlation because of the 
frustration. Instead, the square of Xij can diverge at the critical temperature of the spin- 
glass ordering, which leads to the spin-glass susceptibility xsg the definition of which is 
given by 


Xsg = 


1 \ ^ .2 _ 1 \ ^ f drrii 

N L? 1 Xij) ~N^ \d(phj 




h3 


(1.4) 





Although the spin-glass susceptibility xsg is a suitable quantity to detect the spin-glass 
ordering, it cannot be directly observed in experiments. A more tractable quantity in 
experiments is the nonlinear susceptibility whose definition and the relation with xsg is 
given as 


d 3 m(H ) 
dH 3 


H=0 



(1.5) 


where H is the uniform external field. This equation shows that the divergence of xsg 
also leads to the divergence of Xni- For example, a plot of y n i for AuFe near the transition 
point is given in fig. 11.11 



Figure 1.1: Temperature dependence of the 
linear xo — (dm/dH)\ H=0 and nonlinear 
Xi = Xni susceptibilities for AuFe (1.5-at. 
% Fe). A cusp and divergence are observed 
in Xo an d Xii respectively, at a critical tem¬ 
perature T c . From |3J. 



Figure 1.2: Linear susceptibility x °f CuMn 
vs temperature for 1.08-, 2.02-at. % Mn. 
After zero-field cooling (H < 0.05G), the 
susceptibilities in a field H = 5.90G (b) 
and (d) increase as the temperature grows, 
while the susceptibilities (a) and (c) in the 
field H = 5.90G, which applied above the 
critical temperature T c before cooling, are 
almost constants. From |5j. 


Another characteristic property of spin glasses is the strong hysteresis phenomena. 
We depict an example of the linear susceptibility of CuMn alloys in fig. 11.21 To obtain 
this figure, the linear susceptibility was observed in two different situations. One is the 
so-called zero-field cooling. In this situation, the system is first cooled down below the 
critical temperature T c in the absence of the external field. After that, a constant field 
(H = 5.90G in this experiment) is applied and the linear susceptibility is observed at 
several temperatures with increasing temperature. The other is the field cooling, in which 
a constant field (H = 5.90G) is applied to the system above T c and the linear susceptibility 
is observed at several temperatures with decreasing temperature. Figure \U1 1 shows clear 
differences in those two situations, which implies the ergodicity breaking of the spin-glass 
system at low temperatures. The ergodicity breaking means that the system cannot 
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explore all the states and the state of the system even after a long time depends on 
the initial condition. Once the spin-glass transition occurs, the ergodicity breaks and the 
system shows the strong dependence on the initial condition, which can be observed in the 
hysteresis of the linear susceptibility as fig. 11.21 This interesting behavior of spin glasses 
strongly motivated the researchers in the 1970-80’s, and theoretical interpretations were 
intensively explored. In the next section, we will briefly see the mean-field description of 
spin glasses. 

1.2 Mean-field theory 

In the previous section, we have seen some concepts and quantities to characterize the 
spin-glass behaviors, and some experimental observations were provided. The next step 
for understanding spin glasses is to define a model of spin glasses to deal with the problem 
in theoretical ways. The so-called EA model introduced by Edwards and Anderson [3] 
is the first model of spin glasses. In this model, the interactions are introduced between 
the nearest neighbor spins and are assumed to be the random variables drawn from an 
identical independent distribution. The EA Hamiltonian takes the following form 

M’ = -Y, J a S i S v (f-6) 

(i,j) 

where S denotes an Ising variable and is the random interaction. The symbol (i, j) 
means that the summation runs over all the pairs of neighboring spins. Edwards and 
Anderson solved this model within a mean-field scheme, but the detailed properties were 
unclear. Then, to investigate the EA model in more detail, Sherrington and Kirkpatrick 
introduced the infinite-range version of the EA model, which is called the SK model [6]. 
The SK Hamiltonian is 

M > =~Y, J H s iS j , (1.7) 

i<j 

where the summation runs over all pairs. The SK model is more tractable than the 
EA model because all the spins are fully connected and are symmetric. By analyses 
of the SK model, it was shown that a second order phase transition occurs and the 
spin-glass phase appears at a finite temperature T c . In the SK model, the cusp of the 
linear susceptibility and the divergence of the spin-glass susceptibility are observed, and 
some aging phenomena are also confirmed by some analytical and numerical results [ZH9]. 
Because of this good agreement with experimental results, it is considered that the mean- 
field model extracts some essence of spin-glass behaviors and nowadays the SK model is 
regarded as a standard model of spin glasses. 

An especially remarkable property of the SK model is the coexistence of a huge number 
of thermodynamical states. These states are called “pure states” and the properties are 
considered as the essence of the mean-held description of spin glasses. In the next section, 
the notion of pure states and some related properties are explained. 
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1.3 Pure state and its implications 

1.3.1 A simple introduction to the concept of pure states 

A pure state is a somewhat abstract concept and represents a certain unit of the state 
of the system in the thermodynamic limit. To explain this concept, let us first review 
a pure ferromagnetic system as an example. In a ferromagnetic system, there are two 
possible thermodynamic states at low temperatures. The first one is the state for which 
the magnetization is positive, and for the other one the magnetization is negative. If there 
is no element favoring one of signs of the magnetization (i.e. boundary condition, magnetic 
held etc.), the partition function of the system includes both contributions equally and 
we can express this statement symbolically 

Z = Z + + Z_ (z + = z_), ( 1 . 8 ) 

where Z + is the summation of e~^ H over the spin configurations for which the magnetiza¬ 
tion is positive, and similarly for Z_. However, when a perturbation favoring a direction 
of the magnetization is applied to the system, e.g. the positive magnetic held, the value of 
Z+ exceeds Z_. This difference becomes larger and larger in the thermodynamic limit even 
when the magnetic held is a positive inhnitesimal, and the partition function converges 
to 

Z ->• Z + . (1.9) 

If the magnetic held is negative, the partition function Z converges to Z_. These facts 
indicate that there are two distinguishable states in the thermodynamic limit. These 
distinguishable states are the ‘pure states’, and the number of pure states for this system 
is two. 

Meanwhile, the present mean-held theory of spin glasses, which was mainly constructed 
by Sherrington and Kirkpatrick ( 6 j and solved by Parisi |T2]jT3], tells that the number of 
pure states of spin glasses increases exponentially as the system size grows. Let us assume 
that an index 7 denotes a pure state and the corresponding partition function is expressed 
by Z 7 . Each pure state has its own free energy / 7 = —TlogZ 7 . In the large system limit 
N —y 00 , the mean-held description tells us that the number of pure states with the free 
energy value /, is scaled as 

^(/) = !>(/*/-») ~ e w5:( 7 (1.10) 

7 

where the characteristic exponent £(/) is called the ‘complexity’ or ‘configurational en¬ 
tropy’. For the ferromagnetic case, the unbiased partition function (11.81) includes two 
pure states, Z + and Z_, and both of them give the same value of the free energy. For 
spin-glass systems, however, each pure state can yield a different value of the free energy. 
From a naive speculation of thermodynamics, it seems that the actual system prefers the 
lowest free energy state than the other states with higher values of free energy, but it is 
not the case. A reasonable explanation to this fact is to remember that each pure state 
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cannot access each other because of infinitely high free energy barrier. This is the same 
situation as in the ferromagnetic case. Thus, when the system is once stuck in a pure 
state, the system never reaches other pure states without external forces. In the statistical 
mechanical model, all of such states are included in the partition function, and both the 
free energy value and the number of pure states are important. For general spin-glass 
systems, using eq. (ll.lOjh we can write the partition function as 


Z = E ^ = f #^(/)e-"« ~ J dfe »< 


-/3/+E(/)) 


( 1 . 11 ) 


This equation indicates that the equilibrium value of free energy —(3f eq = lini v^oc log Z/N 
is equal to the saddle point value max/{— /3f + £(/)}. This relation is quite similar to 
the conventional microcanonical one — (3f = ma x u {—/3u + s(w)}, where u is the internal 
energy and s(u) is the corresponding entropy, and implies that the complexity E(/) plays 
the role as the effective ‘entropy’ for the ‘internal’ free energy /. 

Before ending this subsection, we note that the notion of the pure state is different 
from that of the metastable state. Intuitively, metastable states are simply local minima 
of the free energy in the phase space. The system with many metastable states shows 
the slow dynamics at low temperatures but it ultimately relaxes to its equilibrium state 
because the metastable states are not completely separated by free energy barriers and 
can be accessed each other in a sufficiently long term. On the other hand, pure states are 
also minima but they are separated by infinitely high free energy barriers. The system 
with many pure states also shows slow relaxation but never reaches its equilibrium state 
due to those infinitely high free energy barriers. Hence, pure states are very stable in 
comparison with simple metastable states, and the discrimination of pure and metastable 
states is the key concept of the mean-held theory of spin glasses. 

However, when we perform real and numerical experiments, we can only treat finite 
size systems in a finite time scale. This leads to a difficulty in identifying the origin of the 
slow dynamics of spin glasses, because the phase spaces are never completely separated in 
finite size systems and the observation in a finite time scale cannot reject the possibility 
that the observed slow dynamics is due to the shortness of the observing time. Hence, 
we cannot easily distinguish pure and metastable states. This difficulty is an essential 
problem for studying spin glasses. To support the mean-held description, we should 
examine more detailed properties predicted from the mean-held theory. In the following 
subsections, we present some numerical and real experiments supporting the mean-held 
description. 


1.3.2 Relations between pure states and dynamical behaviors 

Existence of many pure states directly explains the ergodicity breaking of spin glasses. At 
high temperatures, the system has only one pure state and the system relaxes to the pure 
state without depending on the initial state. Below the critical temperature, however, the 
system goes into the spin-glass phase and many pure states appear. Since each pure state 
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has different properties (order parameters) and is separated by infinitely high free energy 
barriers, once the system is stuck in one of the pure states, properties of the system is 
determined only by that state and the system never reaches other states without external 
perturbations. 

This description can be examined by some numerical experiments for the theoretical 
models of spin glasses. We here elucidate a simple example of such experiments. To 
this end, let us consider an annealing experiment of glassy and non-glassy spin systems. 
Such numerical experiments are called simulated annealing. The actual procedures are as 
follows: 

1. Set the temperature so high that the system is in the equilibrium state. 

2. Decrease the temperature to zero gradually. 

3. Observe the energy of the system at zero temperature. 

When the decreasing rate v c is too large, the system cannot follow the equilibrium state 
and cannot reach the ground state at zero temperature. On the other hand, if the de¬ 
creasing rate v c is sufficiently small, we can find that a typical non-glassy spin system is 
always in the equilibrium state and finally reaches the ground state at zero temperature. 
For a typical spin-glass system, however, this procedure does not work and the system 
cannot reach the ground state. In an idealized situation (the system is infinitely large), 
this is the case even in the slow cooling limit v c —>■ 0. An important point is that we 
can qualitatively predict the value of the energy which the spin-glass system takes in the 
slow cooling limit v c —> 0, by accepting the description of pure states. For the typical 
spin-glass system, the complexity £(/) takes finite values in a range /_ < / < /+, and can 
be assessed in the statistical mechanical framework without any considerations about the 
dynamics. In the zero temperature limit, contributions from entropy vanish and the com¬ 
plexity becomes a function of the energy u , E(w), defined in a range u_ < u < u + . The 
typical functional form of E(u) is given in fig. 11.31 As in fig. 11.31 the complexity usually 
takes its maximum at the maximum of the energy range, which means that it is highly 
possible that the system is trapped by the pure states with the energy u + . Actually, for 
the annealing experiments conducted in some infinite range models, it is observed that the 
energy which the system finally takes is equal to u + as in fig. 11.41 [HUE] • This accordance 
in the qualitative level between the analysis of pure states and the dynamical behavior in 
annealing experiments strongly supports the validation of the present mean-field theory 
of spin glasses in a certain kind of spin-glass models. 

1.3.3 Hierarchical structure of pure states in the mean-field 
model 

A fact that many pure states coexist in a system also implies that the values of a certain 
kind of order parameters can vary from sample to sample of materials, or from trial to 
trial of experiments. To precisely explain this matter, let us consider a situation that we 


13 






S(u) 



Figure 1.3: The complexity at zero temper¬ 
ature for the typical spin-glass system. The 
complexity £(w) takes the maximum at the 
highest energy u +1 which implies that the 
pure states at u + dominate the dynamical 
behavior of the system. 


u 



Figure 1.4: Schematic diagram of the inter¬ 
nal energy for a temperature range in the 
simulated annealing. The actual ground- 
state energy is given by but the system 
cannot reach the state, since many pure 
states with higher energies exist. Conse¬ 
quently, in decreasing the cooling rate v c , 
the energy seems to converge the highest 
energy u + where pure states exist. 


have two replicated spin-glass systems, where these systems share the same interactions 
{ Jij} but the states of spins independently vary, and compare the behaviors of these sys¬ 
tems. This situation is unfeasible in real experiments but is easily realizable in numerical 
experiments. In this situation, the following quantity, which observes the mutual over¬ 
lap between the two replicated systems labeled by ( 1 ) and ( 2 ), becomes important for 
revealing the emergence of many pure states 

( 1 . 12 ) 

i 

where denotes the ith spin of the system (k). If there is only one pure state, the 
systems ( 1 ) and ( 2 ) are in the same pure state at equilibrium and q 12 always takes the 
value independent of the initial conditions and trials of experiments. Hence, the typical 
distribution of g 12 , P(g) = [(<5(g — q 12 ))]j where the brackets [■ ■ -]j denote the average 
over the random interactions J and are called the configurational average, shows a delta 
function P(q) = <5(g — go) with a certain average value go- However, if there are many 
pure states, each system will be trapped in a different state since the dynamics of the 
systems (1) and (2) are independent each other. Hence, g 12 takes a different value at every 
experiment and the distribution P(g) becomes a broad function. Interestingly, this P(g) 
can be analytically assessed in the mean-held theory [T21IT3] and the schematic diagram 
of P(g) is presented in fig. 11.51 Of course, the distribution P(g) can also be assessed in 
numerical experiments and we refer to a numerical result in fig. 11.61 The correspondence 
between the analytical and numerical results is good and this fact justifies the present 
mean-held solution for the SK model. 
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P(q) 


P(q) 



Figure 1.5: Schematic diagram of P(q) for normal ferromagnetic systems (left) and the 
SK model (right). 



4 

Figure 1.6: The distribution of spin-glass order parameter Pn(q) for finite N of the SK 
model with T = 0.4 and zero external held h — 0. The dotted line is the analytical 
prediction given in [T21IT3] . From [14]. 
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The broad P(q) implies that the overlap between two pure states a and /3, i.e. q a/3 = 
(1 /N) JA (Si) a ( Si)p where ((• • • )) a = (1 /Z a ) Tr a (- • • )e~^ H denotes the thermal average 
over the pure state a, takes different values depending on the selection of two pure states. 
The mean-field theory can provide not only the behavior of P{q) but also some useful 
information of the structure of the pure states. Let us consider a three-point probability 
distribution P(qi, q 2 , < 73 ), which represents a joint probability of the overlaps between three 
arbitrary pure states; for three arbitrary pure states cq/3 and 7 , P{q \, < 72 , q-s) represents 
the probability that their mutual overlaps g a/ 3 ,g " 7 and q take the values < 71,172 and < 73 : 


^(91,92,93) 


y uj a uj^S(q 1 - q afi )5(q 2 

_a,/3, r y 


g° 7 )%3 



j 


(1.13) 


where u a denotes the probability weight of the pure state a. I 11 the mean-field solution 
of the SK model, it is known that this distribution shows a characteristic behavior 

P{Qu 92, 93) = ^P(qi)x(qi)S(qi - q 2 )S{qi ~ 93) 

+ 2 {P(qi)P(q 2 )®(qi — q 2 )S(q 2 — < 73 ) + (two terms with 1, 2, 3 permuted)} (1.14) 

where x(q) = f ( } dq'P(q') and 0(x) is the step function which takes Q(x) = 1 for x > 0 
and 0(x) = 0 otherwise. The first term on the right hand side is non-vanishing only if the 
three overlaps are equal to each other, and the second term requires that the overlaps be 
the edges of an isosceles triangle (qi > q 2 , q 2 = q%). This means that the distances between 
three pure states should form either equilateral or isosceles triangles. This property is 
called the ultrametricity, and the ultrametricity implies that the pure states consist a 
hierarchical structure as in fig. 11.71 


q 



Figure 1.7: A schematic diagram of the hierarchical structure in the space of pure states 
labeled by A-G. The distance between C and D equals q 2 being equal to that between C 
and E and to that D and E, which is smaller than <71 being equal to that between A and 
C and to that C and F. This hierarchical structure satisfies the ultrametricity. 


The ultrametricity seems to be highly mathematical and to have no useful information 
about real experiments. However, there are some experiments indicating that real spin 
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glasses have hidden hierarchical structures in the phase space. Next, we present some 
examples of such experiments. 

1.3.4 Experimental supports of the hierarchical structure 

Two characteristic effects are observed in spin-glass materials. One is the ‘rejuvenation’ 
effect and the other is the ‘memory’ effect. These are considered to be the evidence that 
the states of real spin glasses constitute the hierarchical structures in their phase spaces. 
We here give a simple explanation about these two effects. 

Consider an experimental situation that a small ac field is applied to a spin-glass mate¬ 
rial. The magnetic ac response is observed. If the ac response is delayed, the susceptibility 
has two components; an in-phase one x' and an out-of-phase one x" ■ This out-of-phase x" 
is zero in the paramagnetic phase but becomes finite in the spin-glass phase and relaxes 
slowly as fig. 11.81 which signals the aging of the system. 


8 Hz 
4 Hz 



t (min) 


Figure 1.8: Relaxation of the out-of phase susceptibility x" °f CdCr 1 . 7 Ino. 3 S 4 for different 
frequencies. The curves are shifted vertically by an amount x'o for the sake of clarity. 
From [15] . 


In the above experiment, we can change the temperature and observe the response of 
the system. Figure HTU1 shows the behavior of x" in a cycle of temperature; the temperature 
is kept a constant T = 12K< T c for t\ = 350min.. During in the aging, the temperature 
is suddenly decreased from 12 to 10K and kept at T = 10K for t 2 = 350min., and the 
temperature is increased to the initial temperature T = 12K and x" is observed for 
£3 = 350min.. This figure fT9l clearly shows two extraordinary behaviors. One is that 
the relaxation of x" shows a sudden jump when the temperature is decreased, which 
implies that the aging restarts from a ‘younger state’. This is the rejuvenation effect. The 
other is the continuity of the two separated curves at T = 12K, although the system has 
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Figure 1.9: Relaxation of the out-of phase susceptibility x" (frequency 0.01 Hz) of 
CdCr! 7 In 0 . 3 S 4 during the temperature cycle given in the text. The rejuvenation effect 
occurs at the point where the temperature is suddenly changed from T = 12K to 10K, 
and the memory effect is observed at T = 12K, despite of the rejuvenation at 10K. The 
inset is the jointed figure of both parts of 12K, which clearly shows the memory effect. 
From [16], 


experienced the rejuvenation along the way. This phenomenon indicates that the spin 
glass has held the perfect memory about the past state at T = 12K. This is the memory 
effect. 

These phenomena are characteristic behaviors of spin glasses, and can be interpreted 
by assuming that the metastable states of a spin glass constitute a hierarchical structure. 
This structure splits into many states as the temperature decreases and becomes more 
and more complicated as fig. 11.101 According to this description, the rejuvenation effect 
occurs as the result of splitting of the metastable states when the temperature decreases. 
Decreasing temperature produces new more stable states by splitting the space of the 
states and the system restarts relaxing to those stable states. On the other hand, the 
memory effect is due to the vanishing of the metastable states by increasing temperature. 
The states which the system explores at a low temperature are integrated into the same 
state when the temperature increases. This means that the process of the system at the 
low temperature does not influence the state at the high temperature, which causes the 
memory effect of the temperature. This hierarchical structure of the metastablc states 
is considered to be related to the hierarchical structure of pure states in the mean-field 
theory. 
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rejuvenation 



Figure 1.10: Schematic picture of the hierarchical structure of the metastable states of a 
spin glass 


1.3.5 The mean-field theory and more 

In the previous subsections, we have seen some evidence supporting the mean-field theory 
of spin glasses. In addition, a recent mathematical study na shows that the mean-field 
solution constructed by Parisi [T21IT3] is rigorous for the SK model. These facts constitute 
the firm foundation of the mean-field description of spin glasses. 

At this point, there are some ways to proceed with the spin glass theory further. 

One way is to go beyond the mean-field theory. Treating more realistic models, e.g. 
finite dimensional systems or systems with correlated interactions { J , 3 } etc., is a naive 
one to better understand real spin-glass systems. However, in spite of the success of 
the SK model, direct knowledge on finite-dimensional spin glasses or correlated systems 
is yet limited. Analytical approaches in finite dimensions are rather difficult and many 
researches rely on numerical calculations. However, even numerical approaches often do 
not work well for spin glasses because of the slow dynamics at and below the critical 
temperature. Frustrated systems like spin glasses often have many metastable states, 
and these metastable states prevent the system from relaxing to the equilibrium states, 
which means that the correct sampling of equilibrium states for frustrated systems at low 
temperatures often fails. Although the spin-glass transition of the SK model is definitely 
the equilibrium one and the phase space splits into many pure states at the transition 
point, the numerical simulations cannot identify the appearance of the pure states as 
the origin of the slow dynamics. Consequently, we do not have sufficient theoretical 
descriptions of finite dimensional spin glasses and there are some different arguments 
about their low-temperature behaviors [181420] . These are very important and interesting 
problems, but we do not treat them in this thesis. 

Another way is to refine the mean-field theory of spin glasses and to apply it to other 
subjects. Actually, in the last two decades, the spin-glass theory has been applied to many 
subjects and compared with other approaches in different disciplines m The notion of 
pure states can be generalized to other problems and many research areas are included 
in the scope of the mean-field theory of spin glasses. For example, structural glasses [22]. 
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super-cooled liquids [23], information processing tasks [24,25] and so on. Especially, a 
statistical mechanical approach based on the spin-glass theory to the information tasks 
has provided many fruitful results which influence not only the informatics but also the 
spin-glass theory itself. 

As the basis of such interdisciplinary researches, the mean-field theory of spin glasses 
provides some useful concepts and mathematical tools. The replica method is the most 
powerful one of such tools. Expressing in a simple term, we can identify the replica 
method as a mathematical technique to calculate the averaged quantities which are hard 
to assess by other usual methods. Many problems can be treated in a unified way in 
the framework of the replica method m On the other hand, in spite of many successes 
of the replica method, the mathematical foundation and the physical interpretation of 
this method still have some mysterious parts. Such mysteries of the replica method are 
the main subject of this thesis. Next, we briefly explain the basic concept of the replica 
method and how it is used in actual situations, and eventually state the objective of this 
thesis. 


1.4 The replica method 

For the study of spin-glass models, the exchange interactions J between spins should be 
treated as the random variables. There are some ways to treat the randomness based on 
the time scales of the spins and the exchange interactions. The time scale of spins are 
determined by how often the spin flipping occurs in the system, while the time scale of 
the exchange interactions is dominated by the spatial motion of the atoms (impurities in 
alloys). If time scales of spins and interactions are almost the same, we should take both 
the averaging simultaneously. This situation is called the annealed case. The annealed 
partition function becomes 

where Tr$ means the summation over the spins. The angular brackets [• • - ]j denote the 
average over the random interactions J and are called the configurational average. Some 
frustrated systems like spin glasses are, however, not correctly described by the annealed 
average, because the frustration is relaxed by motions of the atoms. To correctly describe 
spin glass behaviors, we must consider a situation that the time scale of spins is drastically 
shorter than that of interactions. This situation is called the quenched case, in which the 
interactions are fixed as constants, and the partition function becomes 

Z(J)= Tr e ~P^(s\ J )' (1.16) 

In quenched systems, we should treat the partition function leaving the random variable 
dependence J, but this treatment is quite difficult. For a class of quantities, however, the 
values of the quantities depending on random variables converge to the averaged values 
with the probability 1 in the large system size limit N —)■ oo. These quantities are called 


^anrp 


Tr e -pje(s,j) 

L S 
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the self-averaging quantities, and an important point is that the free energy is also one of 
such quantities. Accordingly, we just calculate the averaged free energy / as 


~Pf 


lim 

N—> oo 


-1 log Z(J) 


(1.17) 


Assessing eq. (11.1711 is, however, seriously difficult. The replica method is employed to 
overcome this difficulty. To precisely state the details, we here define the generating 
function 4>(n) as 


<M«) = ilog[(Z(J))”]j, (1.18) 

4>(n) = lim (j>N{ri). (1.19) 

N—> oo 


The basic idea of the replica method is the following identity expressed in terms of </>jv(n) 
as 

~Pf= Jim [log Z(J)]j = lim lim(1 .20) 

TV—>-oo iV N —^oo n—>0 QTl 

Thanks to this identity, the average of the logarithm [log Z(J)\j is replaced by the average 
of the nth moment [Z n ]j. Unfortunately, assessing the average [ Z n ]j for general n e R 
is still difficult. To avoid this difficulty, the replica method additionally performs the 
following procedures; 


• The asymptotic behavior of [( Z(J)) n ]j in the limit N —» oo is calculated for natural 
numbers n = 1, 2, • • • € N by using some analytical techniques like the saddle-point 
method. 

• The obtained solution of [( Z(J)) n ]j for n E N is extended to n E 1 by using their 
analytical continuation. 


The first step is necessary because the direct assessment of [(Z(J)) n ]j is unfeasible even 
for neN, and the second one is inevitable to take the n —> 0 limit. 

The procedures of the replica method mentioned above are necessary but appear rather 
mysterious. Actually, these procedures cause two possible problems: 


1. The uniqueness of the analytical continuation from natural to real numbers. Even 
if all the moments of [( Z(J)) n ]j are given for n 6 N, it is impossible to uniquely 
continue the analytical expressions for n E N to n E R (or C). 

2. The analyticity breaking of (j)(n) = lim^-_ > . 00 </>jv(n). In general, even if 4>n{p) is 
analytic with respect to n for finite N, the analyticity of (j>{n) = linpv-Kx> 0 jv(^) can 
be broken. 


Especially, the second problem is essentially related to the complex behavior of spin 
glasses. It is known that the analyticity breaking with respect to n actually occurs in 
some spin-glass models and such analyticity breaking relates to the replica symmetry 
breaking (RSB). Nowadays, we have some prescriptions to handle the RSB and we can 
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obtain a correct solution, which is proposed by Parisi in 1979 [T2UT3] . even though the RSB 
occurs. Unfortunately, however, the Parisi solution requires some mysterious procedures 
in the evaluation of the free energy, and its full comprehension is not still obtained. 

The subject of this thesis is to investigate the problems related to the RSB from some 
perspectives. We have mainly two results; one is about the interpretation of the RSB. The 
RSB is considered to correspond to the emergence of many pure states. We reexamine 
this description by treating a specific model and resolve some new aspects of the replica 
method. Second is a proposition of a new method to detect the RSB as singularities with 
respect to n. This method is based on the Lee-Yang description of phase transitions (26] 
and is applicable to any singularities with respect to n. Our results will be useful for 
supporting the correctness of the replica method and making the meaning of the RSB 
clearer. 


1.5 Overview of thesis 

In this thesis, we treat the problems related to the replica method and the RSB. Some 
considerations and new methods are proposed to reveal the mysteries of the RSB. 

To state the problem precisely, we introduce the replica method with a detailed ex¬ 
planation in the next chapter. Its practical applications are also presented by treating 
some typical models. To reconsider the replica result from a microscopic viewpoint, we 
also present the so-called TAP equation m This method reproduces the replica result 
and is useful to understand the microscopic properties of pure states. 

In chapter 3, we reexamine recent progresses about the replica method. Particular 
ingredients of the progresses are summarized as follows: 

1 . Relationship between the generating function 0(n) and the probability P(f) that 
the free energy — log Z/N/3 takes a value /. 

2. Connection with complex structures of phase spaces (pure states) and a formalism 
of the RSB. 

To extensively investigate these two statements, we concentrate on the investigation of 
the Ising perceptron |24j by using the replica method with the RSB. The Ising perceptron 
is a model of a neuron which generates a map from to {+1,-1}, and is characterized 
by the value of ratio a = M/N, where M is the number of random patterns stored in the 
perceptron. The reason why we treat this model is that the meaning of complexity for the 
perceptrons of finite size is clearer than that for other systems. For the fully connected 
models, including the Ising perceptrons, a pure state at zero temperature can be identified 
with a stable cluster, the detailed definition of which will be given in the same chapter, 
with respect to single spin flips [28j, 29]. For samples of small systems, the size of the 
clusters can be numerically evaluated by exhaustive enumeration without any ambiguity. 
This property is extremely useful for justifying theoretical predictions through numerical 
experiments. Investigating the Ising perceptron analytically and numerically, we have 
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found that the replica method cannot correctly detect the phase-space structure of the 
Ising perceptron, which is due to the strange distribution of the cluster size. This also 
affects the probability distribution of the free energy P(f) and the replica method cannot 
correctly calculate P(f) in a certain region. The origin of this failure is also explained in 
the same chapter. 

In chapter 4, apart from the notion of pure states, we concentrate on the analyticity 
of 4>(n) with respect to the replica number n. For this purpose, we propose a new scheme 
based on the Lee-Yang theory about phase transitions [26j. In particular, we observe zeros 
with respect to n of the averaged nth moment [Z n \ = 0. In terms of the analyticity, the 
RSB can be regarded as an analyticity breaking of 4>(ri). This motivates us to observe the 
zeros of [Z n ] to obtain useful information about the RSB. To investigate these zeros, we 
treat some tractable systems, i.e. the ±J models with a symmetric distribution on two 
types of lattices, ladder systems and Cayley trees with random fields on the boundary. 
There are two reasons for using these models: Firstly, these models can be investigated in a 
feasible computational time by the cavity method [301131] . Especially, at zero temperature 
this approach gives a simple iterative formula to yield the partition function. Employing 
the replica method and the cavity method, we can perform symbolic calculations of the 
nth moment of the partition function [ Z n ], which enables us to directly solve the equation 
of the objective zeros [ Z n ] = 0. The second reason is the existence of the spin-glass phase. 
It is known that the spin-glass phase is present for Cayley trees [32ff35| and is absent 
for ladder systems. Therefore, we can compare the behavior of the zeros, which are 
considered to be dependent on the spin-glass ordering. Our results indicate that the zeros 
approach the real axis of n for some Cayley trees but not for ladder systems, which seems 
to be consistent with the presence and absence of spin glass ordering. However, further 
investigations reveal that the singularities speculated from the zeros of Cayley trees are 
not related to the RSB. This topic is quite complicated and the details are given in the 
main texts of chapter 4. We also discuss a general possibility that the zeros of [ Z n ] with 
respect to n cannot examine the full-step RSB, but this argument has some uncertainties 
and we cannot give a reliable conclusion. To investigate this point futher, we also examine 
the zeros of [Z n ] with respect to n for the so-called regular random graph. The regular 
random graph is locally similar to the Cayley tree, which enables us to treat this system 
in a manner similar to the Cayley tree in the large system limit, but has some global 
loops, which introduce nontrivial correlations into the system and is considered to lead 
to the RSB at low temperatures. However, any appealing result cannot be obtained by 
this investigation because of the computational difficulty for assessing [Z n ] of the regular 
random graph. The RSB is still a great mystery both from mathematical and physical 
points of view. 

To remove some ambiguities of the discussions given in chapter 4, we tackle the RSB 
by investigating some tree-like systems in another way in chapter 5. In this chapter, 
we observe the zeros of the partition function with respect to the external held H and 
temperature T for the ±J model on Bethe lattices. A Bethe lattice is an interior part of 
the infinitely-large Cayley tree and shares similar properties to those of the Cayley tree. 
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The result shows that an extraordinary response to deviations of the external field and 
temperature exists for spin glasses on Bethe lattices, which is often identified with the 
RSB and implies the existence of the RSB in these models. This observation supports 
our previous discussion that the zeros of [Z n ] with respect to n cannot detect the full-step 
RSB, which means that we need some modifications to obtain information about the RSB 
from the zeros with respect to n. Investigation along this line is an important future work. 

The last chapter is devoted to a conclusion of this thesis. 
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Chapter 2 

Review of the replica method and its 
interpretations 


In this chapter, we review the replica method in detail. This method requires some 
complicated and mysterious prescriptions in the calculations. Hence, the meaning of 
the mathematical manipulations and physical interpretations have been examined from 
various perspectives for a long time. Our review in this chapter includes the recent 
progress in this point. In particular, a relation between the replica symmetry breaking and 
pure state statistics, and a relation with the large deviation theory, are quite important for 
the interpretations of the replica method. We will explain these topics by demonstrating 
the actual calculations for some typical models. 

2.1 Replica calculations for the fully-connected £>-spin 
interacting model 

The SK model presented in the previous chapter is the basic model of spin glasses. This 
model has long-range interactions and each spin is connected to all the other spins. This 
property is useful for the exact treatment of the model because all the spins are symmetric 
and can be equally treated. The detailed analyses of the SK model developed many 
useful concepts and analytical tools, and eventually provided a comprehensive view of 
spin glasses. 

When investigating spin systems, we only treat the two-spin interactions usually. This 
is because the interactions between the nearest neighboring spins are considered to be 
sufficient to capture the behavior of many physical systems. Actually, the SK model 
also has only the two-spin interactions. However, to demonstrate the replica method, we 
here treat the fully-connected p-spin interacting model as an example. The reason is the 
following: 

1. The SK model (p = 2) is naturally included. 

2. It is known that there are qualitatively different phase transitions for p > 3. 
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3. A particular limit (p —y oo) makes the analysis easier, which is suitable for the 
demonstration of the replica method. 


Thus, we hereafter concentrate on the analysis of the fully-connected p-spin interacting 
model. The Hamiltonian of this system can be written as 


Jtf(S\J) = - V (2.1) 


where i is the site index and S is the Ising spin variable. The interaction is a 

quenched random variable, the distribution function of which is given by 

/ N p - ] \ ^ f NP - 1 , x2 l 

p(<4 -^ = (7%^) exp {“ }■ (2 ' 2) 

We adopt appropriate normalizations N p_1 and p\. This is because the physical quantities 
should be appropriately scaled, e.g. the average of the Hamiltonian is extensive, in the 
limits N —)■ oo and p —> oo which we will take afterward. If we set p = 2, this model is 
reduced to the SK model. Following the prescription of the replica method, we calculate 
the generating function 4>(n) = hmjv-x> 0 (log[Z n ]j)/A’. Assuming neN, the nth moment 
of the partition function can be assessed as 


IZ"]J = I n = TV exp | ^0 V 

= ^exp {^ E (v E s - s -)' + , 


E 

v/i=l 


S? 


s f 



(2.3) 


where the symbol Tr denotes the trace over all the spins and /i and v represent the replica 
indices. In deriving the final expression in eq. (12.311 . we have used the following relation 


1 

Np- 1 


E S ‘: 




Si = 


N 

p\ 



(2.4) 


and left only the leading term. It is convenient to introduce the variables 


'r = jrZ s ^ 


S p ■ S v 

N 


(2.5) 


to replace the spin product terms JESTS'?' /N in eq. (12.31) . We treat q pv as a dummy 
integrating variable and use delta functions 6 ( Sp ■ S u — Nq pu ) to satisfy the constraint 
(12.51) . We also use the Fourier-transformed expression of the delta function 


S (SP ■ S u - NqP u ) 



dqP 1 ' 

~2tT 


exp (^(SP ■ S v 


Nqp v )) . 


( 2 . 6 ) 
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Substituting these expressions, we rewrite eq. (12.3|) as 


r I B 2 T 2 N 

[Z n }j = Tr Yl dq^dcP u exp 1 ^— Y^Y - N Y < 

f n<v 




EWeW) +j^JVn|. 

M< y \ i / J 


(2.7) 


The spin trace can now be independently taken at each i 

1 Ie Z„<,r(l = ^ Tre E„ < „5’"S‘-sO' V = exp{AflogTi'e J: »<- lf ‘" s '‘ s “ 


( 2 , 8 ) 


Using the saddle point method, we obtain the generating function </>(n) = limjv-x» log[Z n ]j/lV 
for n G N as 


B 2 7 2 

Mn) = Extr <, -- 

qfiu j^jLv I 2 


Y^Y - Y q ' lV Y w + ~P 2 J 2 n + log Tr e^<" \ , (2.9) 


where the symbol Extr^, represents to take the extremization with respect to x. The 
extremization condition yields 


= 


11 D D 6 _ Tf" = -vB 2 J 2 (a^Y~ l 

Tre E ^^ 5MS " ’ g 2 PP [Q } ' 


( 2 . 10 ) 


Taking this extremization condition is, however, quite difficult, in the general form. Hence, 
we need some ansatz to reduce this extremization problem to a tractable one. 


2.1.1 Replica symmetric ansatz 

To proceed further, we are required to determine the explicit dependence of q on 
the replica indices /j and v at the saddle point. For n 6 N, an equality [(S'fS'HJj = 
[{S q Si) n \j, where (• • -) n denotes the average over the replicated Boltzmann factor 
holds for any different combinations of replicas (/j ^ v and 7 /u), which is due to the per¬ 
mutation symmetry of 22 ^ 3>if{S^\J) with respect to the replica indices. This observation 
naturally leads to an ansatz that the saddle point of eq. (12.91) has also the same symmetry, 
which is the so-called replica symmetry (RS). Under the RS, the order parameter matrix 
q^ becomes 

<r = q,r u = q, ( 2 . 11 ) 

and the physical meaning of q^ v is easily understood. To see this, we note that eq. (12.101) 
can be written as 

<r = [{SfSO J-r, (2.12) 

which is almost clear from the definition of q^ u (12.51) . In the RS ansatz, each replica is 
independent and equivalent, which means that the contributions from replicas 7 ^/iy 
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are canceled out and the averaged quantity belonging to different replicas gives the same 
value 


r = msxh = 


Tr S^e~^ s>L l J) Tr 


= [<$> s 


(2.13) 


which is the spin-glass order parameter explained in chapter 1. 

Using the RS, we can easily calculate the terms in eq. (12. 9 p to derive 


"D, 'l' 1 "'?'" = -’<(" - Ij'J'J. 


(2.14) 


/ 2 < V 

Tr e 


= Tre^ 2 ^^ 5 ^ = e 2 n ? fDz (2 cosh , (2.15) 


where the last equation is derived by using the Hubbard-Stratonovich transformation 


exp 1 r) =^ 


L^ exp ('T + 2I ) = /^ expM - 


(2.16) 


where TR is the Gaussian measure dze~^/\f2n and we hereafter assume that the domain 
of integration of jDz is ] — 00 , 00 [ if there is no explicit indication. Substituting the above 
expressions, we can reduce 4>(n) in eq. (12.9p to 4> R s( n ) as 

0RS W = Extr< --- L p 2 q p --- -qq + ~p 2 n 

q,q 4 2 4 


—-ug + log j Dz (2 cosh \^z^j 1, 


(2.17) 


where we hereinafter put J = 1 for simplicity of the notation. Taking the extremization 
condition with respect to q and q, we get 

[Dz ( cosh \/q'z] f tanh \/qz] 1 

q = -^- 7 ’ - L , q= XP/ 3 V- 1 . (2.18) 

f Dz (cosh \fqz) z 

Fortunately, under the RS the expression of (p R si n ) can be extended to n 6 R, which 
enables us to take the n —» 0 limit. The resultant free energy /rs can be derived as 


—/ 3 /rs 
= Extr 


r d(j) RS (n) 

lim — a - 

n-> 0 on 

l a2 „ 1 ^ 1„2 u 
~l^ + 2 qq+ l^ 2 q + 


Dz log 2 coa\i{\/~qz) 


(2.19) 


The extremization condition gives the state equations (12.181) in the limit n —> 0, and now 
the problem is solved in the RS level. Unfortunately, this RS solution gives unphysical 
behaviors, e.g. negative entropy, at low temperatures. Next, we study this point in more 
detail by treating the particular limit p —y 00 . 













2.2 The solution in the limit p —> oo 

2.2.1 Failure of the RS solution 

To demonstrate the failure of the RS ansatz, we here analyze the p —> oo limit. In this 
limit, the system becomes rather simple and we can derive the exact solution without 
employing the replica method. First, let us study the RS solutions. In the limit p —> oo, 
there are two possible solutions to eqs. (12.18(1 , namely the paramagnetic solution (q, q) = 
(0,0) and the spin-glass solution (q,q) = (l,+oo). Substituting these solutions into eq. 
(12.19(1 . we obtain the paramagnetic and spin-glass free energies, fp and /rs sg respectively, 
as 


-/3/p = \ fS 2 

+ log 2, 

(2.20) 

— /3/rssg —> 

/2f 

\ - > Too. 

V vr 

(2.21) 


The divergence of /rssg clearly shows an inconsistency of this spin-glass solution. On 
the other hand, the paramagnetic solution also shows the unphysical behavior at low 
temperatures. The entropy of the paramagnetic solution sp is 

s P = log 2 - i/3 2 . ( 2 . 22 ) 

This clearly becomes negative below T c = l/(2y / log2), which implies that there should 
be a phase transition above T c . At least in the RS level, we do not have any candidate to 
correctly express the low temperature behavior of this system. Before seeing the correct 
solution in the framework of the replica theory, we employ the microcanonical approach 
in order to obtain the correct low temperature behavior. 

2.2.2 Microcanonical approach 

The microcanonical approach starts from calculations of the energy distribution of the 
system ( 12 . 1(1 in the limit p —> oo as the microcanonical ensemble 

P(E(S)) = [5(E-H(S\J))]j. (2.23) 

The configurational average can be carried out by using the Fourier expression of the 
delta function. The result becomes a Gaussian distribution and does not depend on the 
spin configuration 

P(E{ S)) = P(E) = p(-A). (2.24) 

The two-point probability distribution P(E 1 (Si), E 2 (Si)) for two independent configura¬ 
tions of spins S 1 and S 2 is similarly calculated 

PiE^S 1 ), E 2 (S 2 )) = [SiE, - JP(S 1 \J))5(E 2 - J?(S 2 \J))]j 


) 



1 PYn ( E \ + E\ E\ - E\ 

Nil \J (1 + qP)( 1 - qP) CXP V 2JV(1 + qP) 2N(1 - qP 
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where q = S 1 ■ S 2 /N. Under the assumption that the spin configurations S 1 and S 2 are 
thermodynamically distinguishable, the value of \q\ is smaller than 1 , which means that 
q p goes to 0 in the limit p —* oo and 

P{E 1 (S 1 ),E 2 (S 2 )) P{E 1 )P{E 2 ). (2.26) 

Hence, the energy distribution of two different spin configurations is completely indepen¬ 
dent for each configuration. We can prove that the same property holds for any multi¬ 
point distributions by following similar discussions. Consequently, each energy level for 
each spin configuration can be treated as an identically independently distributed (i.i.d.) 
Gaussian random variable, the distribution of which is given by eq. (12.241) . Due to this 
property, this model is called the random energy model (REM) [36] and the free energy 
of the REM can be assessed by the microcanonical approach. 

The microcanonical approach utilizes the entropy to yield the thermodynamical be¬ 
havior of the system. Because each energy level is i.i.d. for the REM, the number of 
states with energy E can be calculated as 

n(u) = 2 N P(Nu) = _L e ^(i°g 2 -u 2 ) . ( 2 . 27 ) 

v Ntt 

where we put u = E/N, which represents the energy per spin. This relation implies that 
in the limit N —> oo, there are very many states for the range |it| < \/log2 = it 0 but none 
in the other range \u\ > Uq, and the entropy for \u\ < it 0 is given by 

s(u) —logn(E)— log 2 — u 2 . (2.28) 

An illustration of the entropy s(u) of the REM is given in fig. 12.11 Using this entropy 

S(u) 



Figure 2.1: The shape of entropy s(u) of the REM. 


function s(u), we can construct the free energy f(T) from the definition 

f(T) = max {u — Ts(u)} = max {it — T(log2 — it 2 )} . 
M<u 0 |«|<«o l 


(2.29) 


where T is the temperature. In the usual case, the temperature T is equal to (ds{u)/du)~ l 
as the definition of temperature in the microcanonical ensemble. This is actually the case 
for T > T c = l/(2\/log2). In this region, eq. (I2.29|) gives 

fp = -\V-T log 2 (T > T c ). (2.30) 
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Figure 2.2: A pictorial expression of the 
derivation of the free energy for T > T c . The 
free energy is given by the u-intercept of the 
tangent to the curve s(u) with slope (3. 


Figure 2.3: A pictorial expression of the 
derivation of the free energy for T < T c . The 
free energy is given by the nearest value of u 
to the tangent of s(u) with slope (3. 


On the other hand, for T < T c , the maximum of eq. (I2.29P is given by u — —Uq and the 
free energy is 

fsc — _ \/iog2 = —u 0 (T < T c ). (2.31) 

These free energies (12.301) and (12.311) are the exact solution of the REM. 

The above discussion is easily understood by using pictorial expressions given in figs. 
12.21 and 12751 What we should do is to find a tangent to the curve s(u ) with slope (3. We 
denote the abscissa of the tangent point as u*. For T > T c , this abscissa u* = —(3/2 is 
in the range |n| < Uq, and then the maximum in eq. (I2.29p is given by u*. The figure 
corresponding to this situation is fig. 12.21 On the other hand, for T < T c , this value u* is 
out of the range \u\ < Uq, which means that there is no physical state for the energy level 
u*. In such a situation, the maximum of eq. (I2.29P is the nearest value of u to u* under 
the condition |w| < w 0 , which leads to / = — u$ — Ts(-uo) = — uq. 

Before ending of this subsection, let us consider relations between the microcanonical 
solution (I2.29p and the RS result. As we can see easily, for T > T c the paramagnetic 
solution of the RS (I2.20P is identical to the microcanonical solution. As the temperature 
decreases, the entropy of the paramagnetic solution decreases and vanishes at T = T c , and 
below T c the free energy is kept as a constant at the value of T = T c . These observations 
imply that the spin glass transition of the REM is due to the vanishing entropy of the 
paramagnetic phase. This is a characteristic feature of the REM and this transition is 
sometimes called the frozen transition. 

To obtain the correct solution in the replica theory, it is known that the so-called 
replica symmetry breaking (RSB), which allows q^ u to depend on the replica indices, is 
required. Next we introduce the RSB in a general framework. 
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2.3 Replica symmetry breaking 


In order to obtain the low temperature spin-glass phase, we must treat q^ in more general 
forms. Although the correct form of q^ is unknown, Parisi has proposed a particular 
ansatz which describes a hierarchical breaking of replica symmetry |121ll3j . The Parisi 
scheme is constructed from the following recursive algorithm: 

(i) First step: The n replicas are grouped in n/rrii clusters of mj replicas. Within the 
same cluster, each q (/i ^ v) has a value q\ . Two replicas in different clusters have an 
overlap q^ v — q 0 < q\. 

(ii) Second step: Each cluster of size rri\ is broken up into mi/m 2 sub-clusters of m 2 
replicas. Any two replicas in the same sub-cluster have overlap q^ = q 2 > q\ . The other 
overlaps remain unchanged. 

Continuing this procedure, we obtain the general h-step RSB (/cRSB) situation 

n > mi > m 2 ■ ■ ■ > m k > 1, q k > q k _ 1 > ■ ■ ■ > qi > q 0 . (2.32) 


Each q k is interpreted as a hierarchically constructed spin-glass order parameter and m k 
is called the breaking parameter. The following example is for the case of the 2-step RSB 
such that n = 12, mi = 6 , m 2 = 3, 


un 


0 q 2 (?2 

<?2 0 q 2 

<?2 <?2 0 

<?i 

\ 

Qo 

Qi 

0 <?2 <?2 

<?2 0 q 2 

<?2 <?2 0 

% 

0 <?2 <?2 

(?2 0 q 2 

<?2 <?2 0 

Qi 

Qi 

0 q 2 q2 

q 2 0 q 2 

?2 ?2 0 J 


(2.33) 


Taking the limit n —> 0, we assume that the parameters {m k } become continuous and the 
following inequalities hold; 

n < mi < m 2 < ■ ■ ■ < 1, (2.34) 

which are the inverse relations of eq. (12.3211 . All the parameters {m k }, {q k } are determined 
by taking the extremization condition of </>{n ). The above procedures are all the ingredi¬ 
ents of the Parisi scheme. The full-step (k = 00 -step) RSB (FRSB) is also constructed in 
a similar manner but the concrete procedure is quite complicated and we here only refer 
to [24 ], 

Physically, the RSB is considered to be related to the emergence of enormous number 
of pure states. According to this speculation, the RS ansatz describes situations that only 
a small number (subexponential number of the system size N) of pure states exist, and 
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the failure of the RS solution at low temperatures is due to the neglect of many pure 
states in the spin-glass phase. 

Curiously, it is known that most models only show two types of RSB: The 1RSB and 
FRSB. In either case, it is considered that there are many pure states but the intricacy of 
the phase space structure is different depending on the step of RSB. Generally speaking, 
as the step of RSB becomes higher and higher, the phase space structure is considered to 
become more and more complicated. 

Although our knowledge about the FRSB is still rather poor because of intricacy of 
the FRSB construction, the 1RSB solution has been intensively studied and its relation 
to pure states is well understood nowadays ra- In the following, we mainly treat the 
1RSB solution and explain the relation with many pure states in detail. 


2.3.1 The 1RSB solution for the p-spin interacting model 


Under the 1RSB ansatz, the replica indices are divided into n/m groups of identical size 
m, and q^ and q^ u are parameterized as 


(gi, q\ ) ( yU and v belong to the same group 

(go, go) ( otherwise ) 


(<r,<n = 

Under this assumption, we can transform the term v q fJ-u S ti S L ' as 


(2.35) 


J2 q lxu S»S v 





2 n/m / m \ 2 

E s ") + ffi-«oE ( E s “ 

block \/xG block 


nqi 


(2.36) 


where the first term on the right-hand side fills up all matrix elements of { q with g 0 . 
The second term replaces the elements in the block part with gi and the last term sets 
the diagonal elements to zero. Similarly, we derive 


5^(<f T = \ n( K m ~ l ) ( f\ + \ n ( n ~ 




y q^ v q^ v = ]-n(m - l)gigi + - n(n - m)q 0 q 0 - 


(2.37) 

(2.38) 




Combining the Hubbard-Stratonobich transformation and eq. (12.36jh we obtain 


_ e -Sin/2 


n/m ( 

/ r>z Q n \ i 

( Dz\ TT e (v / 5b 2 o+\/7i-w 2 i) s ' 1 i 

' block l ^ 

/xG block ) 


(2.39) 


In this expression, we can perform the spin trace for each replica spin independently. 
Substituting all the results into eq. (12.9(1 . we get 


0irsb (n,m) = Extr 

91,90,91,30 


/d 2 /3 2 1 

— (n(m — 1 )q\ + n(n — m)q q) + — n — - ng" 1 


^n(m - l)gigi - ^n(n - m)q 0 q 0 + log f Dz 0 ( / Dz\{2 cosh h) r 


n/m ' 


«. (2.40) 
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where we put h = \J%Zq + \Jq\ — qoZ\. Taking the extremization condition, we get the 
following equations of states: 

fDz 0 (/Ds 1 (cosh/Q’")" /m 

fPz 0 (fDz 1 (coshh) m ) r, ^ m 

fDz 0 (fDz 1 (coshh) m ) n/m 

fPz 0 (f Pzi(cosh h) m ) n ^ n 

9i = \pfi 2 q i~\ 9o = \pp 2 p(ll~ l - 

If we set qo = Qi = q, the RS solution (12.1711 and (I2.18P is reproduced. In the limit n —* 0, 
we can derive the free energy parameterized by m 


(2.41) 

(2.42) 

(2.43) 


d 


P 2 


P 2 


-/3/irsbM = lim ^-0iR S B(n, m) = Extr^ < — ((m - l)ql - mql) + — 
on 


qi,qo,qi,qo 


~qi ~ - l)qiqi + ^mq 0 q 0 + f Pz 0 log ( / Dzi(2 cosh h) 1 


(2.44) 


The extremization condition re-derives eqs. (l2.41IMI2.43p with the condition n = 0. Al¬ 
though the physical meaning of m is unclear at this moment, we here treat m as an 
artificial parameter and take the extremization condition to erase the m-dependence of 
the free energy at the final step of calculations. We will come back to this problem later 
after deriving the correct solution of the REM in the 1RSB level. 


2.3.2 The 1RSB solution in the p —> oc limit 

It is time to solve the REM in the framework of the replica theory. What we should do 
at first is to find the solution of eqs. (I2.41IMI2.43I) . There are three solutions for these 
equations in the limit p —> oo, namely ( qi,qo ) = (0,0), (1,1) and (1,0). For the 1RSB 
solution to be non-trivial, an inequality q 0 < qi, (% < %) must hold, which means that 
(q\. go) = (1,0) is the appropriate solution. Substituting this solution, we get 


— /^/irsb(^) = 

P 2 1 

= -—m H-log 2. 

(2.45) 

4 m 

Variation with respect to m gives 



(mf3) 2 

= 4 log 2. 

(2.46) 

Substituting this value, we obtain 



fsa = 

-\/l°g2, 

(2.47) 


which is identical to the microcanonical solution (I2.3ip below the the transition temper¬ 
ature T c . In the replica theory, the transition temperature is determined by the direct 
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comparison of the free energy value fsc — fp, which is surely identical to that of the 
microcanonical approach. Hence, for the REM, the 1RSB solution gives the exact result. 

The above is the conventional construction of the 1RSB solution without recent per¬ 
spectives about the physical meaning of m. Actually, the RSB solution has more informa¬ 
tion about the phase space structure of the system. We elucidate this point in the next 
section. 


2.4 Pure state statistics of the 1RSB level 

As already mentioned in chapter 1, in the mean-held description of spin glasses, there are 
many pure states in a spin-glass system and the partition function becomes the summation 
over contributions from all the pure states. Each pure state 7 has its own free energy 
—/3/ 7 = (logZ 7 )/A r and the number of pure states having the free energy value /, jV(f), 
is scaled as 

<yr(f)~e N ^ f \ (2.48) 

where £(/) ~ 0(1) is called the complexity. Note that an inequality £(/) > 0 must 
hold, because the complexity is the logarithm of the number of pure states, which cannot 
become negative. This is the same reason as the entropy cannot become negative. Under 
these assumptions, we can write the partition function as 

Z = J2 Z y~ f dfe N (~P f+ ^V\ (2.49) 

7 

where 7 is the index of pure states and 

Z = Tr = Tr e~ pH ^ J) SJS), (2.50) 

' se 7 s 1 

where <5 7 (S) is the indicator function where S y (S) = 1 when S E 7 and S 7 (S) = 0 
otherwise. Equation 02.491) indicates that the partition function is dominated by the 
saddle point of (—/3f + £(/)). For convenience, we define another generating function 
g(x\J) as 

e Ng(x\J) _ dfe N{ dxf+W)) =>. g(x\J) = ^ max {-fdxf + £(/)}, (2.51) 

7 

where the bounds /_ and f + for the range of / come from the constraint £(/) > 0. 
Equation 02.511) implies that, when the complexity £(/) is a convex upward function, the 
complexity can be calculated from the generating function g(x\J) in the parameterized 
form as follows: 

- Wx) = E(/ W ) = g(x \J) - . ( 2 .52) 

So far, we are discussing about one sample of quenched disorder. We here assume that 
g(x\J) is a self-averaging quantity and we can replace g(x\J) by g(x) = \g(x\J)\j. This 
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averaged function g{x) can be expressed by the replica method as 


Ng{x) = [Ng{x\J)]j = 


log (? z *) 


lim — log 

o ay 



(2.53) 


Although exact evaluation of the right-hand side of eq. (12.53(1 is difficult, for x,y G N we 
can derive the following expression: 



£ Tr 

ryl ...^y 


exp -/? £ £ n n MS'") 


IS= 1 fl= 1 


V— 1 (1=1 


. (2.54) 


For the evaluation of this equation, the following observations are important. 


• The summation is taken over all possible configurations of xy replica spins. 

• However, the factor nLiEtiM^ ) allows only contributions from configura¬ 
tions in which xy replicas are equally assigned to y pure states by x. 


These observations are nothing more than the physical situation of the 1RSB ansatz, in 
assessing [Z n (J)]j with substitution of n = xy and m = x (fig. 12.41b Accepting this 


y 


> 

X, 







1 


Figure 2.4: Schematic diagram of the 

rtu (n;;. 1 Ms i "')) 


1RSB description of the factor 


interpretation, we obtain the following expression: 




0irsb (xy, x), 


(2.55) 


where </>irsb (n,m) is the 1RSB solution considered in the previous section. Then, com¬ 
bining eqs. (|2.53j) and (12.551) . we obtain the generating function g(x) in the form 


9 (x) 


lim t^irsb (n = xy,m = x) 
y^o dy 


~xPfiRSB(x), 


(2.56) 
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where /irsb(^) is the 1RSB free energy shown in the previous section. Hence, the RSB 
breaking parameter m corresponds to the parameter x which controls the generating 
function g(x) of complexity, which leads to the following relations from eq. (12.52 jb 

- Pf(x) = -ff gfrfaggW) , S(/(x)) = -dxf 1BSB (x) + Px d{xfl ™ B{x)) . (2.57) 

2.4.1 Pure states of the limit p —> oc 

Here, let us see the complexity of the REM as an example. According to eqs. (I2.44p and 
(I2.57jh the generating function of the p-spin model is given by 

g(x) = jx(x - 1 )(3 2 q p 1 - ^ x(x - l)gigi + ^ 2 x 

— ^xqi + log Jdz ^2 cosh , (2.58) 

where we put go = 0 because the nontrivial 1RSB solution exists only under this condition. 
The value of gi is determined by eq. (I2.4ip . Taking the limits p —> oo and qi —> 1, we 
obtain 

g( x ) = -£ 2 /l 2 + l°g 2. (2.59) 

The parameterized free energy and the complexity are derived from eq. (I2.52p as 

- Pf(x) = £(/0)) = log 2 - ^x 2 0 2 = log 2 - / 2 . (2.60) 

Clearly, this complexity E(/) is identical to the microcanonical entropy s(u) if we identify 
u = /. This can be understood if we remember the construction of the REM. For this 
model, each spin configuration is completely independent of each other as we see the 
independence of each energy level in section 12.2.21 This means that each pure state of the 
REM is constructed from only one configuration, which indicates that the entropy of a 
pure state defined as the logarithm of the number of configurations belonging to the state, 
is 0. Hence, the free energy of a pure state corresponds to the energy of the state, which 
leads to the agreement between the complexity E(/) and the entropy s(u). As might be 
expected, this is a peculiar property of the REM, and in general the complexity S(/) is 
different from the entropy s(u). 

In the microcanonical approach, the phase transition and free energy in each phase 
were easily derived by the pictorial interpretation of eq. (I2.29p . We here reexamine this 
derivation from a view point of the complexity. The form of S(/) is identical to that of 
s(u ) given in fig. 12.11 bv reading u = / and s(u) = S(/). There are two things which 
we should do. One is to derive the phase transition and the equilibrium value of the free 
energy / eq = — T(log Z)/N in each phase. The other is to elucidate relations between the 
derivation of / eq and the conventional prescription of the 1RSB. We start from the first 
point. The equilibrium free energy / eq is obviously equal to — g(l)//3 from the definition. 
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Figure 2.5: An expression of the derivation 
of / eq for T > T c . The free energy is given by 
the /-intercept of the tangent to the curve 
£(/) with slope f3. 


Figure 2.6: An expression of the derivation 
of / eq for T < T c . The point — f 0 where £(/) 
vanishes yields / eq , which is determined by 
the tangent to £(/) with the slope j3x = /3 C . 
The value x = ////? is identical to the ex- 
tremization of /irsb(^) with respect to x. 


The relation between g(x) and the complexity £(/) is derived from eq. (12.51(1 and (12.60(1 
as 

9{x) = f ™f£ I+ {~P x f + S (/)l = max {-Pxf + log 2 - f 2 } , (2.61) 

where / 0 is equal to ^/log 2. As mentioned in section 12.41 the complexity is the logarithm 
of the number of pure states and cannot be negative. Keeping x = 1, for T > T c we can 
easily see that the maximum of eq. (12.61(1 is given by /*(1) = — (3/2, which is identical 
to the abscissa of the curve £(/) with slope j3 as given in fig. 12.51 For T < T c , that 
abscissa /*( 1 ) is out of the range |/| < /o and the maximum of eq. (12.611) is given by 
—/o = — \/log 2 as the microcanonical case, which leads to the correct result / eq — —f 0 . 

The free energies are correctly reproduced from the viewpoint of the complexity. Next, 
we see the relation with the conventional 1RSB prescription. The inequality x = m < 1 
in the 1RSB construction is naturally understood from the specialty of x — 1. For x — 1, 
the generating function g( 1) directly relates to the correct / eq unless the corresponding 
complexity becomes negative. Hence, in the usual case we should keep x — 1 and cal¬ 
culate g( 1), which gives the correct solution for T > T c . For T < T c , however, a naive 
calculation of < 7 ( 1 ) leads to the negative complexity, but this inconsistency is overcome in 
the 1RSB construction as follows. An important point is that the point / = —/o where 
the complexity vanishes is determined by a tangent to £(/) with the slope /3 C = 2-y/log2. 
Hence, to select / = — /o below T < T c , we can modify x of g(x) as x = T/T c . This 
artificial prescription is just the extremization condition of /irsb(^) = — g(x)/(j3x) with 
respect to x. In fact, 


... Id q(x) 
Extr{/ 1 RSB (x)} ^ — 


1 

/ 3x 2 



S(/(x)) 

/ 3x 2 


(2.62) 


which means that the extremization condition of /irsb(^) with respect to x leads to the 
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point, where the complexity vanishes. The equilibrium free energy / cq is expressed in the 
1RSB prescription as 


fe q — /lRSB ( X 




rnaxj {—(3 c f + £(/)} 

Pc 


—fo- 


(2.63) 


Hence, the correct solution is reproduced. These procedures are also illustrated in fig. 12.61 


2.5 Viewpoint from the large deviation theory 


In the previous sections, we gave the replica analysis with the RSB and its interpretation 
from the pure state statistics. In this section, we reexamine this result from the viewpoint 
of the large deviation theory, which treats asymptotic small probabilities of rare events 
in the large system limit. 

For disordered systems, the probability that the free energy, — (1 /Nf3) log Z, will take 
a certain value /, P{f), fluctuates from sample to sample. The large deviation theory 
tells us that, in most cases for large N, this probability P(f) can be scaled as 

P(f)~exp{NR(f)}, (2.64) 


where i?(/)(< 0) is referred to as the rate function. The rate function relates to the 
generating function p(n) as 


= 7V0(n) = [ Z n] j = j dJP(J)e~ Npnf{J) = I dfP(f)e- Npnf 


PH = , max {-pnf + R{f)}, 

J-SISJ+ 


d f e N(-0nf+R(f)) 

(2.65) 


where the bounds f + and /_ are required to satisfy the constraint R(f) < 0, as in the case 
of pure state statistics. If the rate function is a convex upward function, we can express 
the free energy and the rate function in forms parameterized by n 


- PfH 


d p{n) 
dn 


= PH 


— n 


d 4>H 

dn 


( 2 . 66 ) 


This equation and the constraint R(f) < 0 require that the following equation holds for 
Vn: 


PH dp{n) 


< (2.67) 

n on 

Equations (|2.65|) and (12.66P indicate that the typical value of /, which is characterized by 
the condition R(f) = (1/IV) log P(f) = 0, can be evaluated as 


-/V w = ^[logZ]., = lim^, (2.68) 

which is the basic identity of the replica method. The above discussion indicates that n = 
1 , 2 ,... > 0 corresponds to atypical samples of R(f) < 0 representing a small probability. 
This means that the replica method can be regarded as a formula that infers the behavior 
of typical samples by extrapolating the behavior for atypical samples. 
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2.5.1 Re-derivation of the 1RSB transition 


Again we treat the REM as an example. As mentioned in section 12.21 there are two 
solutions for the equations of states (12.18(1 in the limit p —> oo, namely the paramagnetic 
q — 0 and spin-glass q — 1 solutions. Hence, there are corresponding two solutions for 
4>(n) as 


0rs (n;q = 0) = 4> KS i(n) = i/3 * 2 n + nlog2, (2.69) 

0rs( n; q = 1) = 0r S 2(n) = ^-/3 2 n 2 + log 2. (2.70) 


The RSI and RS2 solutions correspond to the paramagnetic and RS spin-glass solutions, 
fp and /rssg given in section 12.21 respectively E If we follow the concept of the saddle- 
point method, the correct solution is given by larger 0(n), but naive application of this 
criterion yields incorrect results. To treat this problem precisely, we should distinguish 
regions T > T c and T <T C . 

We first treat the high temperature region T > T c . The correct solution of 0(n) in 
this region is given by 


f fe(n) (n > np(T) = (4 log 2)/ /3 2 = /3 2 //3 2 ) 
\ 0rsi (n) (n < n P (T)) 


which gives the correct free energy —j3fp = lim n _> 0 (<9(/> R g \(ri)/dn). Note that the bound¬ 
ary np(T ) > 1 is determined by equating two solutions </>rsi and 0 rs 2 , which agrees with 
the concept of the saddle-point method, but another intersection at n — 1 is ignored in 
the solution (12.71(1 even though the RS2 solution exceeds the RSI below n — 1. The 
correctness of this prescription in the present case can be understood from the following 
criteria which should be satisfied by the correct 0(n): 


1 . 

2 . 

3. 

4. 


The generating function 0(n) is a convex downward function with respect to n. 
The rate function R(f(n)) = (f>{n) — n(d(p(n)/dn) is nonpositive. 

An equality lim ?w0 0(n) =0 should hold basically^. 

The entropy s = (d/dT)(lim n ^. 0 (d(ft(n)/dn)/(3) cannot be negative. 


The RS2 solution clearly violates the third criterion which comes from a fact that for finite 
N the generating function 0at(u) = log[Z n ]j/N necessarily becomes 0 at n = 0. Hence, 
we choose the RSI solution as the correct one in the whole range of n < 1. This solution 
is illustrated in the left panel of fig. 12.71 Empirically, it is known that an intersection at 
n = 1 should be neglected in most cases, but the general reason is not found and we only 
point out this fact here. 

x Two limits (q, q) —>• (1, oo) and n —> 0 are not exchangeable and the values of free energy are different 
between ~/3fnsSG and hm„_> 0 (d</>RS2/dn). 

2 In some cases, the identity lim n _>o <f>(n) = 0 can be broken even though the similar equality for finite 
N , </>at( 0) = 0, holds, due to taking the thermodynamic limit first. We will see such an example in chapter 

3. 
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Figure 2.7: Behavior of <j>{n). The solid lines represent the correct and dotted lines 
are the RS and RSB branches. The corresponding values of temperature T are 1, T c & 0.6 
and 0.333, from left to right. 


On the other hand, for the low temperature region T < T C1 we need to construct 
another solution for 4>(n) since the solution (I2.71 | ) gives incorrect results, ft is known that 
the correct solution is given by 


cf)(n) 


0RS2 (n) (n > n c (T ) = (2y/log2)//3 = f3 c /(5) 
^ RS n 2 e (nc) n (n<n c (T)) 


(2.72) 


and is illustrated in the right panel of fig. 12.71 The content of this solution is as follows. 
For large n, the larger RS solution, 0RS2(tt), is correct as the high temperature region. 
Decreasing n, we find an intersection of the RSI and RS2 solutions at n — 1, but as 
mentioned in the previous paragraph this intersection should be neglected. Actually, if 
we adopt the RSI solution, we obtain the negative entropy at n — 0, which violates the 
fourth criterion in the previous paragraph. Proceeding to the range of n < 1, we can 
find that the rate function i?(/(n)) becomes positive below n c (T), which violates the 
constraint i?(/(n)) < 0. A natural prescription to avoid this inconsistency is keeping the 
value of i?(/(n)) as 0 below n c , which leads to the solution (12.721) . This prescription can 
be proved to be correct in more mathematically proper procedures which focus on the 
convexity of 0(n) and the monotonicity of 0(n)/n |35] , 

The solution (I2.72|) relates to the 1RSB solution. In fact, if we set qo = 0 in eq. ( 2.40|) . 
which is a necessary condition for the nontrivial 1RSB in the current case solutioro, the 
functional form of </>irsb(?T m) can be expressed by using the RS solution a£| 


0irsb (n,m) 


n 

m 


4>Rs(m). 


(2.73) 


The interpretation of this equation is simple. The equality q 0 = 0 means that each pure 
state is perfectly uncorrelated. Thus, 0 irsb (n,m) becomes proportional to n/m, as we 
can see in fig. 12.41 which comes from the independent y = n/m sets of replicas. In each 
set of the replicas, x = m replicas are included and the overlap qi takes a value, which is 
the same situation as the RS one. These considerations naturally lead to eq. (I2.73j) . 

3 The nontrivial solution of equations of states (l2.41D - fl2.43l) is only given by gi > 0 and go = 0 in the 
present model. 

4 Another 1RSB order parameter gi is identified with the RS one g. 
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Figure 2.8: Phase diagram of the REM on 
the T-/3n plane. The solid lines denote the 
phase boundaries and the dotted line repre¬ 
sents the line n = 1. 


Figure 2.9: Schematic diagram of the com¬ 
plexity £(/) and rate function i?(/). The 
complexity and rate function have disjointed 
domains of definition but their functional 
forms are identical, which leads to that the 
rate function is naturally continued to the 
complexity by using the RS generating func¬ 
tion 0 Rs(n). 


Taking the extremization condition of eq. (12.73(1 with respect to m with fixing T < T c , 
we find that the breaking parameter m becomes equal to n c , and the solution (12.72(1 is 
reproduced. Hence, the solution </>(n) = (</>rs 2 (n c )/n c )n can be regarded as the 1RSB 
solution. Using eqs. (12.7111 and (12.72(1 . we can depict a phase diagram of the REM on the 
T-/3n plane and the result is given in fig. 12.81 If we see the complexity and rate function, 
the relation between the 1RSB construction and large deviations becomes clearer. Using 
eqs. (12.57(1 and (I2.73p . we can express the complexity as 

S (/M) = 0rsM - ( 2 - 74 ) 

the functional form of which is obviously identical to that of the rate function R(f(n)) = 
0rs(r) — n(d(f)Rs(n)/dn), though their domains of definition are disjointed except for a 
point of typical value of free energy / typ (which is identified with the equilibrium free 
energy / eq in the context of pure state statistics), where the complexity and rate function 
become 0. This is also illustrated in fig. 12.91 

Summarizing the above discussions, we have seen the physical significance of the RSB 
from various perspectives by treating the REM as an example. In the remaining sections of 
this chapter, we treat the hnite p cases by utilizing the above discussions. In addition, we 
present some arguments about the microscopic description of pure states, which becomes 
important when we treat problems requiring microscopic information like the optimization 
problems. 
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2.6 Finite p cases 


In this section, we treat the finite p cases of the fully-connected p-spin interacting model. 
Especially, we concentrate on the p — 2 and 3 cases, since it is known that the qualitative 
behavior for p > 4 is similar to either one of those cases. To treat the p — 2,3 cases, 
we need to consider the transition to the FRSB. Although the 1RSB transition can be 
observed by calculating the complexity in the 1RSB framework, the FRSB is signaled by 
the local instability of the RS solution, which is called the de Almeida-Thouless (AT) 
instability [3H|. Hence, we first explain the AT instability, and then present the phase 
diagrams of the p = 2,3 cases. 

2.6.1 de Almeida-Thouless instability 

Let us remember that the generating function <j)(n) has the following form 

4>(n) = Extr < E E q^u + 1 0 2 n + log Tr e £ M<1/ q’-'SI'S" 1 (2.7 5 ) 

9 l. fl<U fl<V ) 

We consider the deviations of the order parameter q^ around the RS saddle-point 

q^ = q + A^, (2.76) 

and expand 4>(n) with respect to A MI/ to second order. The conjugate order parameter 
q pv becomes 

f" = « ip/3 2 bf- 1 + (p - l)<r 2 A'"' + i(p - 1 )(p - 2) (A'"') 2 ! . (2.77) 

hence the leading two terms in eq. (I2.75j) become 

I'Eif')' - tv^E^"") 2 , ( 278 > 

fl<U ll<V p<v 

where we leave only the second order terms because the zeroth order terms are irrelevant 
to the variation of 4>(n), A <p(n), and the first order terms become 0 since we take the 
saddle-point condition with respect to q. Similarly, we can expand the last term of eq. 
([2T5P as 

logTre^o^ 1 '^ 5 " « lp(p- l)(p- 2)/3 2 q p - 3 J2( A ' M ') 2 (^^)rs 

fJ.<V 

+^p 2 (p- l) 2 /3V p - 4 EE A^A 5 “ ({S p S u S s S“) rs - (S fl S u ) KS (5 5 ^> rs ) , (2.79) 

H<v 5<uj 

where the brackets (• • -) RS denote the average over the RS weight e^^ <i/ st * s . Regarding 
that an equality (S 7i S' I ') Rg = 9 holds, we eventually derive the variation of the generating 
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function A <fi(n) as 


A <Hn) = -Ip 2 p(p - l)q p ~ 2 £ E W) 

H<v <5<w L 

-jp(p - 1)/3V- 2 ({S'‘S"S i S“> RS - {S"S"> RS (S s S“) HS ) 1, (2.80) 

where 5^)^s u ) is the Kronecker delta function which yields 1 when (y av ) = (Su>) and 0 
otherwise. We denote the matrix of coefficients of A^ u by G which is called the Hessian 
matrix. The local stability of the RS solution requires all the eigenvalues of G be positive. 
Here we classify the elements of G by using the following notations 

GW) 0 », = 1 - \lKP ~ 1)/3V- 2 (1 - = P (2.81) 

= ~gP(P - l)/5 a <r 2 «S-^ i > Ra - = Q, (2.82) 

GW*,) = -|p(p - «S'‘S"S 5 S") rs - (S'-S^L) = P (2.83) 

Eigenvalues of the Hessian and the AT condition 

Let us hnd the eigenvectors of G by a heuristic approach found by Almeida and Thouless. 
The first eigenvector S! is obtained by assuming A ,IU = a for any p, u. In this condition, 
from the eigenvalue equation Gs\ = AiSi we can easily derive the hrst eigenvalue Ai as 

Ai = P + 2{n - 2 )Q + i(n - 2 ){n - 3 )R. (2.84) 

The next type of solution s 2 is obtained by treating a replica 6 as a special one. We 
assume 6 = 1 without loss of generality. This solution s 2 has A^ v = b when /i or z/ is 
equal to 1, A^ = c otherwise. The hrst row of the eigenvalue equation Gs 2 = A 2 s 2 gives 

(P + (n — 2 )Q)b + ^(n — 2 )Q + -(n — 2)(n — 3)P^ c = A 2 b. (2.85) 

We here impose the orthogonal condition of the solutions s 2 and s i, which leads to 

(n-l )6 + ^(n-l)(n- 2 )c = 0 , ( 2 . 86 ) 

Solving eqs. (12.85(1 and (12.861) under the condition b,c ^ 0, we get 

A 2 = P + (n — A)Q — (n — 3)P. (2.87) 

The third mode s 3 is obtained by treating two replicas 6,ca as special ones. This 
solution s 3 has A 6uj = d, A e ^ = e when o and A^ w = f otherwise. Without loss of 
generality, we put 6 = 1 and uj = 2. The orthogonal condition of Si and S 3 yields 

d + 2(n — 2)e + ^(n — 2)(n — 3)/ = 0, (2.88) 
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and the orthogonal condition of s 2 and S 3 also gives 


d+(n- 2)e = 0, e+^(n-3)f = 0. (2.89) 

The first row of the eigenvalue equation Gs 3 = A 3 s 3 leads to 

Pd + 2 (n - 2 )Qe + ^(n - 2)(n - 3)P/ = A 3 d., (2.90) 

Solving eqs. (12.88jl - (l2.90j) . we obtain 

A 3 = P - 2Q + R. (2.91) 


The eigenvectors s 1; s 2 and s 3 construct n(n — 1)/2-dimensional space, hence all the 
eigenvalues are exhausted by these three modes. 

For the stability of the saddle point, all of the eigenvalues must be non-negative. We 
hereafter concentrate on a region n < 1. In this region, from simple algebras we can see 
that inequalities A 3 ,A 2 > A 3 hold, which means that the mode s 3 is the relevant mode 
for the stability of the RS solution and is called the replicon mode. To obtain an explicit 
form of A 3 , we calculate the factor r = (S^S 11 S 5 in R and the result is 


r = (S^S u S s S u ) rs = 


f Dz cosh" \Jd[z tanh 4 \/ r qz 


(2.92) 


cosh” \/qz 

Remembering (S' 1 S U ) RS in P, Q and R is equal to q given in eq. (12.18(1 . we finally obtain 


A 3 — P — 2 Q + R — 1 


trXp -1 )£V 2 


[Dz(cosh \/b[z) n 4 
f-Dz(cosh \/qz) n 


> 0 , 


(2.93) 


as the AT stability condition of the RS solution. Once the AT stability breaks, it is 
believed that the FRSB solution is required to describe the behavior of the system. 


Connection to the divergence of the spin-glass susceptibility 


As we can expect, the AT condition is related to the divergence of the spin-glass suscep¬ 
tibility xsg which is defined in section 11.11 To elucidate this point, we here calculate the 
spin-glass susceptibility for the fully-connected p-spin interacting model. The following 
calculations are based on those in reference [ 30] , 

We first introduce the modified generating function 0(n, m, F). in which we introduce 
the RS interaction F among m out of n replicas, 


Ncj) N (n , m, F) = log 


Tr e 


-P h 


Tr e P 1 ^ a +£f Fi J2 a< b s?s$ \ 

' J J 


= log 


a Y'' T Y'' n qM rp. Qa ob 

Tr (p <...<ip ' Jx l •■•ip 2_/p 4=1 &i ^ ' 2-^i 2-^a<b 


(2.94) 


L \ / J J 

We hereafter assume that the indices a, b run only among m replicas, while p, v run all 
n replicas. Note that not only the limit F —)■ 0 but also the limit m —> 1 reproduce the 


45 
















normal generating function 4>(n) from eq. (12.941) . The limit m —y 1 can be taken by using 
the analytic continuation from m G N to C 

N 


N(j){n , m, F ) = log 


IDzi (lY e~^ H+ ^= lVViZiSi Y (Tr, 

i =1 '' 


-PH 


(2.95) 


where we have used the Hubbard-Stratonovich transformation. To see the stability of the 
system against introduction F, let us expand <j)(n,m,F) with respect to F. Denoting 
Z(J) = Tr e~P H ^ s \ J \ we can express the first derivative as 


N 


(j) (Tr (E^SiSi) 


an 


Z n ~ m (J) (Tr e 13 sr=i F E a < b 


E O o s£> 


m.F 


, a<b 


n,F 

(2.96) 


where the brackets ((• • • )) mF and [(• • • )] ni j? denote the following averages 

/('...U -_ 1 _ Tv (...) e P^ =1 Ha +i:^ F iJ2 a <b s ? s l 

[(•••)Z"- m (J)Z m (J,F)] J 
U )in,F [Z n - m (J)Z m (J,F)]j 

where we define Z(J,F ) = Tr e^F, a =i Ha +T,i F i'Z2 a <b s i s i ; and the second derivative be 


(2.97) 

(2.98) 


comes 
32 ~ 


N 


d 2 4> 

mdFi 


E E <SJS‘SfS?) 

_a<b c<d 


m.F 


- n,F 


E 0“ s ‘Li 


,CL<b 


n,F 


E ( s f s b 


m.F 


,c<d 


(2.99) 


n.F 


The first term of this equation gives the following three contributions 

m(m “ J + m(m - 1 )(m - 2) 


- n,.F 


m,F 


. n,F 


^m{m — 1 )(m — 2)(m — 3) 


/ Qa QC C^\ 

‘-’fc'-h / 


m.F 


n.F 


( 2 . 100 ) 


Hereafter, we concentrate on the case where m is slightly larger than unity m — 1 + e. 
In this case, eq. (12.1001) yields 0(m — 1) terms. On the other hand, the second term in 
eq. (I2.99j) is negligible because the order is 0((m — l) 2 ). Taking the limit F —y 0, we can 
find that the m replicas become completely independent and ((• • • )) m F is reduced to the 
thermal average ((• • • )) m with respect to the m-replicated original Hamiltonian H a ■> 

which yields the following expressions of the derivatives up to the order 0{m— 1 ), 


N 


d<f> 


OF, 


(m — 1 ) Ar d 2 (p 

O g. N - 


F =0 


dF k dF, 


m — 1 


[((S t s k ) - (S,) {S k ))\, ( 2 . 101 ) 


F =0 


where the brackets [(• • • )] n denote [(• ••)]„ = liniF-i.o[(- ■ ■ )}n,F = [Z n {■ ■ ■ )\j/[Z n ]j. Hence, 
we obtain the modified generating function as 

N$(n, 1 + 6 , F) « N</>(n) + ^qJ2 F * + ^XsgF + 0(e 2 ), ( 2 . 102 ) 
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where F r denotes the transpose matrix of F and xsg represents the spin-glass suscepti¬ 
bility matrix having the component ( \sc)ik = [((S^S*;) — (Si) (S*)) 2 ] . Equation (12.102j) 
implies that the largest eigenvalue of the matrix xsg is related to the stability of the 
system against introduction F. We can expect that the system statistically has the 
translational invariance, which implies that the eigenvector of the largest eigenvalue is 
given by 1 = (1,1, • • • , 1 )/\/N. Hence, the largest eigenvalue becomes 

-tl T X SG l = 1 £ [«S,S„> - <S,} (S,))! = Xsg- (2.103) 

l,k 


This gives a natural extension of the spin-glass susceptibility to the finite replica case 
and implies the relation between the divergence of the spin-glass susceptibility and the 
instability against introduction of interactions between replicas. 

Next, we express (f>(n,m, F) in a more tractable form. Using the replica method and 
following the calculations in section 12.11 we can obtain 


0 (n) 


Extr 

qnv jpjLv 



ll<v fJ.<V 


^/3 2 n + ~ log Tr e L 


(2.104) 


where 








a<b 


(2.105) 


The interaction F breaks the replica symmetry and we should choose the appropriate 
form of to take the saddle point. Without loss of generality, we can assume that the 
RS interaction F is introduced into the first m replicas, (1, ■ ■ ■ ,m). A natural form of 
is then expressed as 


f (<7i, Qi) (H e (1, ■ ■ ■ , m) and v e (1, ■ • • , m)) 
\ (?o,9o) (otherwise) 


(2.106) 


Under this ansatz, we get 


1 ,2 1 


(j)(n, m, F) = Ertx < -ra/3 + ~(n(n - 1) - m(m - 1)) ( -q 0 q 0 + Qo 


+ Er(m - 1) (^-qiq! + + ^logTre L ° 1, 


where 


N 


L « = Y. 1 * E S ‘ S < + ® - 9b + F<) y StSi 


i =1 ^ il<v 


a<b 


(2.107) 


(2.108) 
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The saddle-point condition gives 


v ' i=l \ a<b 

i «(£*<„ s?sr), -<E„< t s“s»> Io 
«» = ivE 


2=1 


n(n — l)/2 — m{m — l)/2 


9i = \ % = ^pP 2 q o \ 


where 




i° Xr e L ° 

In this expression, the derivatives of <p are given by 


Tr(- • • )e L °. 


d<t> 1N <9 2 0 1 , ^dqi 

=-m(m — l)g 1; =- m[m — lj- 


dF, 2N 


dFM 2 N 


dF, 


(2.109) 

( 2 . 110 ) 
( 2 . 111 ) 

( 2 . 112 ) 

(2.113) 


For obtaining the eigenvalue of the Hessian d 2 (pj(dFkdFi), we should calculate dqi/dF^. 
The (statistically) translational invariance of the system enables us to simplify the cal¬ 
culation by putting Fi — F for V/. Differentiating eq. (12.1091) with respect to F, we 
get 


v 7 V ' a<b c<d ' Lq \ a < b / Lo ' c<d / L 0 J 

(2.114) 

where the particular form of the factor C is irrelevant for our current purpose and is 
omitted here. The second term in the braces {■ ■ ■} is again negligible if we consider the 
case m — 1 + e because it is 0(e 2 ). In addition, in the limit F —» 0 we can expect that 
qi and q 0 become the RS spin-glass order parameter q, which leads to that the average 
((■ ■ ■ )) Lo becomes identical to the average ((• • • )) RS in the limit F —> 0. These conditions 
yield 


1 

i a<b c<d / £ Q 

m(m — 1 )(m — 2 )(m — 3) 


->• m ^ m - + m{m - 1 ){m- 2) (S a S b ) 


RS 


(S a S b S c S d ) 


Rs ^-{l-2q + r}, 


(2.115) 


where q and r are defined in eqs. (12.18)) and (12.92)) . respectively. Substituting these 
conditions and dqi/dF = p(p — l)f5 2 q p ~ 2 {dqi/dF)/2 into eq. ()2.114j) . we finally get 


dqi 

dF 


oc 


F =0 


T^PMp 


1 )q p 2 (1 — 2 q + r) 


(2.116) 


Using eqs. (12.181) and (I2.92p . we find that this condition is identical to the AT condition. 
From (12. 101 j) and (12.1131) . the spin-glass susceptibility is proportional to dqi/dF and 
hence the AT condition coincides with the divergence of the spin-glass susceptibility. 
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2.6.2 Phase diagrams for the p = 2, 3 cases 

As mentioned in section [2.5.11 the 1RSB solution can be calculated by the RS solution as 
0irsb (n,m) = (n/m)0Rs(m) in the present rnodej^. The AT condition is also assessed by 
the RS solution and hence the RS solution is sufficient to derive phase diagrams for finite 
p. The resultant plots for p = 2 and 3 are given in figs. 12.101 and 12.111 respectively. The 


P n n=1 



Figure 2.10: Phase diagram of the SK model 
T-/3n plane. The solid lines denote phase 
boundaries. The boundary between RS2 and 
FRSB phases is the AT line and is labeled 
(2). The line n = 1 is drawn dashed. 



Figure 2.11: Phase diagram of the p = 3 case 
on T-/3n plane. The solid lines denote phase 
boundaries. Above the line indicated by (*), 
there are two RS saddle points (q = 0 ,q > 
0). The dynamical transition temperature Td 
exists above the equilibrium transition T c . 


solid lines in figs. 12.101 and 12. Ill represent phase boundaries. We see the contents of these 
phase diagrams in the following. 

First, let us consider the p = 2 case. In this case, the transition temperature T c at 
n = 0 is assessed by the perturbative approach because the transition is of second order. 
We expand the right-hand side of eq. (12.18)1 with respect to q = /3 2 q to second order and 
get 

(3 2 q + (n-2)(3 4 q 2 . (2.117) 

This equation indicates that for n < 2 the transition is of second order and the transition 
temperature is T c = 1 and a phase boundary exists in a vertical form at T c from n — 0 
to n — 2. For larger n, the transition is of first order and it is required to numerically 
solve eq. (12.181) . Above the line labeled by (*) in fig. 12.101 there are two stable solutions 
q — 0 and q > 0, and we call them the RSI and RS2 solutions, respectively, similarly 
to the REM case. For large n the RS2 solution dominates the system in the whole 
range of temperature. For small n, at high temperatures T > T c we can draw a phase 
boundary between the RSI and RS2 phases by equating 0 rsi(^) and </>RS 2 ( ri ) and the 
actual boundary is indicated by the line (1) in fig. 12.101 On the other hand, at low 

5 This is a particular property of models with go = 0. If the external field is introduced into the present 
model, the equality qo = 0 does not hold any more, and we must consider the 1RSB solution directly. 
We will treat such a model with go 7 ^ 0 in chapter 3. 
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temperatures T < T c , we must consider the RSB of the RS2 solution. The line where the 
AT stability breaks is the AT line which indicated by (2) in fig. 12.101 Below the AT line, 
the system requires the FRSB solution. Although there exists a region where the rate 
function assessed by the RS2 solution becomes positive below the AT line, that region is 
irrelevant because the RS solution does not hold any meaning below the AT line. In the 
low temperature limit f3 —> oo, we can analytically derive the asymptotic behavior of the 
AT line. We here omit the detailed calculations and only give the result 


/3n « 



(2.118) 


Hence the AT line diverges in the T-/3n plane. 

Next, we consider the p — 3 case. In this case, transitions are of first order and we need 
numerical calculations to determine phase boundaries. Unlike the SK (p = 2) case, there 
is a region where the 1RSB solution is relevant, which is signaled by the behavior of the 
rate function R(f(n)). The line indexed by (3) denotes the critical condition R(f(n)) = 0 
and below this line the rate function is naturally continued to the positive complexity, 
which means the emergence of the 1RSB phase. The meaning of other symbols in fig. 
12. Ill are the same as in the p = 2 case. The equilibrium transition from the paramagnetic 
to 1RSB phases occurs at T c and the equilibrium free energy / eq shows a singularity at 
this temperature. In addition, at lower temperatures the AT line (2) exceeds the line (3), 
which leads to another phase transition at Tc- The system is dominated by the FRSB 
solution below the AT line, and the transition from the 1RSB to FRSB is sometimes 
called the Gardner transition jTT] . 

Another important fact for the p = 3 case is that a non-equilibrium transition, the 
so-called dynamical transition, occurs at T&. At this temperature, the equilibrium free 
energy does not show any singularity, but the phase structure of the system drastically 
changes. For T > T ( [, only the paramagnetic solution q — 0 exists for n = l[§, which 
means that the complexity takes 0 at f — fp and — oo otherwise. On the other hand, for 
T c <T < Td, there are two solutions q > 0 and q = 0, which indicates that the nontrivial 
1RSB saddle point exists and many pure states appear, which yields the complexity in 
a certain range of free energy. These pure states affect the dynamics of the system and 
the system cannot reach the equilibrium states, although the equilibrium value of free 
energy / eq is completely the same as the paramagnetic one fp for T > Td- This transition 
is sometimes called the dynamical 1RSB transition (dlRSB). In the REM, there exist 
two solutions q — 1 and q — 0 in the whole temperature region and we did not realize 
the existence of this dynamical transitioij^]. This dynamical transition revealed by the 
complexity analysis is also confirmed by some numerical approaches mmm which 
directly investigate dynamical properties. The complexity is nowadays considered to be 

6 Remember the 1RSB-RS correspondence (12.7311 . i.e. the replica number n of the RS solution corre¬ 
sponds to the 1RSB breaking parameter to, and the specialty of m = 1. 

7 We can also interpret as that the dynamical transition temperature of the REM is Td = oo. 
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one of the most important concepts to understand not only dynamical behaviors of various 
systems but also the replica method itself. 


2.7 Microscopic description of pure states 

In this final section of this chapter, we present the microscopic description of pure states 
of spin glasses. A basis of this attempt is the so-called TAP equation which is a set of 
equations with respect to the local magnetizations {rrii} and is first derived by Thouless 
et al. [27J. 


2.7.1 TAP method 


We here treat the SK model, the p = 2 case, as an example. The TAP equation for the 
SK model is given by 


rrii = tanh /3 < ^2 + hi — /3(1 — q)rrii 

l i/* 

For readers interested in the derivation of this equation, we refer to 
ing TAP free energy /TAp({"ii}) is expressed as 

Nf T Ap({mi}) = - ^2 - T 22 so (rrii) 


(2.119) 
The correspond- 

( 2 . 120 ) 


i<j 


where 


1 + rrii /T + rrii 

So{q,mi) = --—log 


1 — rrii , /1 — m,- 

—^— lo S 




1 8 2 

= — - log(l — m 2 ) — rrii tanh" 1 (m i ) + log 2 + ^-(1 — q) 2 . 


( 2 . 121 ) 


where q is the spin-glass order parameter and equals to (Yl m ‘i.)/N- Taking variation of 
/TAp({ r «i}) with respect to m^, we again obtain eq. (12. 1 19j) . 

In the TAP context, pure states are identified with the solutions of eq. (I2.119|fl The 
number of TAP solutions with the free energy value /, Atap (/), is hence given by 

( ^/tap ({"!*}) 


Atap (/) — /n{ drriid 


\ dm 

where G is the Hessian of the TAP free energy 

d 2 fTAp({rrii}) 


|detG|,5(/TAp(M)-/), (2.122) 




dmjdmi 


— —Jij + ( 8( i — q) + 


8 1 — ml 


Hy 


(2.123) 


8 Historically, the notion of pure state was first founded through analyzing the TAP equation. 
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The TAP complexity is defined by £tap(/) = (l°g^TAp(/))/-^ and is assumed to be self 
averaging, which leads to the quantity to be calculated as 

^tap (/) = —[log E ArAp(/)]j- (2.124) 

This was first formulated by Bray and Moore [44] and is reexamined many times [3203- 
02]. The calculations are straightforward but rather involved and we only give a sketch 
of actual calculations and refer the results of m- The evaluation procedure is as follows: 

1. Replace [log M / (/)]j by log[M /n (/)]j by using the replica method. 

2. The modulus of |detG| is removed to simplify the calculation (there is no a priori 

justification of this assumption) and det G is expressed by using Grassmann variables 
-0j in an integral form det G = f Hi {d^idA) exp ■ 

3. The delta functions in eq. (I2.122|) are transformed into the Fourier expressions as 
<5(/TAp({ r? h}) - /) = / du/(2m)exp{u(f TAP ({mi}) - /)} , and all the relevant 
factors are expressed in an exponential form exp(A) with an effective action A. 

4. The configurational average is performed and then the RS and the Becchi-Rouet- 
Stora-Tyutin (BRST) supersymmetry are imposed on the effective action A. 

5. Finally, the complexity is assessed by using the saddle-point method and taking the 
n —> 0 limit. 

Note that it is known that the RS assumption usually yields the same result with the 
annealed approximation [logMrAp(/)]j ~ log[MrAp(/)] j, and actual calculations are also 
performed in this approximation in m as other references [441 - 146] . Leaving a parameter u 
which determines the value of TAP free energy /tap, we can express the TAP complexity 
as 

Stap(/; u) = i P 2 u(-u - 1 )q 2 + y uq - ^ 2 u 

T log Jdz (2 cosh v^) — /3uf (2.125) 

Taking the maximization with respect to u gives the TAP complexity for a free energy 
value /, E T ap(/). Comparing eqs. (12.581) with p = 2 and (I2.125p . we can find a formal 
correspondence between the TAP complexity and the generating function g(x) assessed 
in the 1RSB level as 

S T ap(/;w = ~x) = g{x) +/3xf. (2.126) 

Taking the minimization with respect to x of the right-hand side yields the complexity in 
the replica theory of the 1RSB level, hence the TAP and replica theories completely give 
the same result. This fact supports not only the consistency of different methods but also 
the correctness of microscopic description of pure states based on the TAP equation. 
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2.7.2 Zero temperature limit 

In the previous discussion, we have seen that pure states statistics based on the mi¬ 
croscopic description, the TAP method, gives the same result as the replica one. To 
investigate the microscopic description of pure states in more detail, we here concentrate 
on the zero temperature limit. In this limit, pure states are related to stable configurations 
against single spin flips. 

Although it is possible to propose some stabilities of a spin configuration at zero 
temperature, the stability against single spin flip can be considered as the most natural 
one. Consider a spin S', at site i and the effective field 

hf = V J ijSj . (2.127) 

jA* 

The stability condition of {S’*} against any single spin flip is that inequalities 

hfSi > 0 (2.128) 


hold for all i. This is the same condition as equalities 



(2.129) 


hold for all i. Since m; can be identified with the spin Si in the limit f3 —y oo, eq. (12.1291) 
is nothing but the TAP equation at zero temperature with a condi tioij(3 


j3(l — q) 0. (2.130) 

Equation (12.1291) and the discussion in the previous subsection imply that pure states at 
zero temperature are connected to stable spin configurations against any single spin flip. 

Note that this simple relation is, however, considered to be peculiar to the fully- 
connected models. This important fact was first pointed out by Biroli and Monasson [29], 
In order to follow their discussion, we here define a k-stable configuration as the configu¬ 
ration the energy of which cannot be decreased by flipping any subset of k (or less than 
k ) spins. In this context, pure states of fully-connected models at zero temperature cor¬ 
respond to 1-stable spin configurations. Denoting the number of /c-stable configurations 
with the energy density e as Mfc(e), we can define a kind of entropy of /c-stable config¬ 
urations, Sfc(e), as Sfc(e) = (log jV k (e))/N in the N —* oo limit. Biroli and Monasson 
have shown that the TAP complexity Etap(c) is identical to Soo(e) by treating a hybrid 
system of one dimensional and fully-connected models. They have also alleged that the 
/c-stable entropy s*.(e) does not depend on k in the fully-connected models, which leads to 
an accidental correspondence between Etap(c) and si(e). This peculiar property to the 
fully-connected models can be understood as follows: Let us denote the energy deviation 

9 This condition has some delicate points as pointed out in S3, but we do not treat this problem and 
only adopt the condition /?(! — q) — > 0 in the limit /? — > oo. 
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induced by flipping a spin Si as A Ei. If we flip two spins Si and Sj, the energy deviation 
A Eij equals to A E i3 = A Ei + A Ej — 2J %] S % S r This energy deviation A Eij becomes, 
however, A = AEi + A Ej in the N — y oo limit because J l3 is scaled as 0(1/y/N), 
which means that a 1-stable configuration is also 2-stable, and the same holds for all k. 
Therefore, Sk(e) does not depend on k and s\ — ■ ■ ■ — Soo — Etap- 

In conclusion, the microscopic description of pure states is given by the TAP equation. 
The TAP method gives a simple description of pure states for the fully-connected models, 
but for more realistic models there still remain some unclear points about the existence 
and the properties of pure states. 

2.8 Summary 

In this chapter, we reviewed the replica method in detail by treating the fully-connected p- 
spin interacting model as an example. The relation between the replica symmetry breaking 
(RSB) and the emergence of many pure states was closely explained and the distribution 
of pure states, the complexity £(/), was calculated in the 1-step RSB (1RSB) level. This 
description of the 1RSB was also reexamined from a viewpoint of the large deviation 
theory, and the 1RSB transition was interpreted from the rate function R(f(n)). In our 
particular model, the complexity and rate function share the same functional form, which 
implies a close relation between these quantities. In addition, the microscopic description 
of pure states was presented from the TAP context. At zero temperature it was explained 
that stable spin configurations against oo-spin flips correspond to pure states, but for 
the fully-connected models pure states are also identical to the stable spin configurations 
against single spin flip. It was shown from a simple discussion about the energy balance 
that this property is peculiar to the fully-connected models. 

Viewpoints from pure state statistics and the large deviation theory proposed in this 
chapter are rather recent results. In past days the RSB formulation was performed without 
realizing these backgrounds and some confusing discussions were proposed. This chapter 
is written to clarify these points by comparing conventional and modern operations of the 
RSB. 

Pure states at zero temperature generally correspond to spin configurations stable 
against oo-spin flips after taking the thermodynamic limit N — y oo, but for the fully- 
connected models such configurations are the same as 1-stable spin configurations. This 
peculiar property is useful for identifying pure states to numerically evaluate the com¬ 
plexity. In the next chapter, we will utilize this property and calculate the complexity 
numerically to verify the prediction of the replica result. 
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Chapter 3 

Analyses of weight space structure 
and rare events in the Ising 
perceptron 


In the previous chapter, we introduced the replica method and also elucidated its aspects 
as a tool to obtain the pure state statistics and large deviations. In this chapter, we 
reexamine these aspects extensively by treating a model of a neuron, namely the so-called 
Ising perceptron. 

As seen in sec. 12.51 the rate function R(f), which represents a small probability of 
atypical samples, and the complexity £(/), which represents a large number of pure 
states that appear for typical samples, share not only the similar mathematical structure 
but also the same functional form for the fully-connected p-spin interacting model. This 
fact naturally motivates us to further explore more general relationships between R(f), 
and £(/), including cases for which the formal accordance of functional forms between 
R(f) and £(/) does not hold. 

The Ising perceptron considered here is a simple model of a neuron and stores random 
input-output patterns. There are two reasons for considering this system. First, the 
Ising perceptrons can be macroscopically characterized by a few sets of order parameters 
and are relatively easier to handle. Despite the simplicity, it is known that this model 
exhibits rich behavior in the phase space involving nontrivial RSB phenomena [lEtSH! 
and is considered to show different functional forms of R(f) and £(/), which is highly 
suitable for our purpose. The second reason is that the meaning of complexity for the 
Ising perceptrons of finite size is clearer. For the Ising perceptrons, a pure state at zero 
temperature can be identified with a stable cluster, the definition of which will be given in 
section 13.41 with respect to single spin flips [2511291150] . For samples of small systems, the 
size of the clusters can be numerically evaluated by exhaustive enumeration without any 
ambiguity. This property is extremely useful for justifying theoretical predictions through 
numerical experiments. 

Our investigations reveal that the generating function g{x) of the complexity £(/) 
shows an extraordinary behavior, the origin of which is that S(/) and R(f) of the Ising 
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perceptron are not convex upward functions, which is assumed in usual analyses. The 
results presented in this chapter are summarized in reference [51 j. 


3.1 Model 


A simple perceptron is a model of a neuron, the function of which is a map from R^ to 
{+1, — 1} as 




(3.1) 


where x G R w is the input pattern and y G {+1,-1} is the output label. The vector S 


denotes the synaptic weights. We hereafter focus ou the Ising weight case, in which each 



Figure 3.1: A conceptual picture of a simple perceptron. 


synaptic weight only takes Si — ±1. In a general scenario, the perceptron stores a given 
set of M labeled patterns 




(3.2) 


by adjusting the weight S so as to completely reproduce the given label y M for the input 
x^ for fi — 1, 2,..., M. 

In the following, we consider a situation in which the patterns are independently and 
identically distributed (i.i.d.). In the conventional situations of the neural networks, a 
network consisting from Ising perceptrons is considered and in that situation the input 
a; is a set of outputs of other perceptrons [24]. This means that the input x is usually 
chosen as random signs x* = ±1, but in the thermodynamic limit we can regard S ■ x 
as multivariate Gaussian random variables due to the central limit theorem. Hence, it is 
convenient to assume the following distributions 



(3.3) 


P(v) = \ 1) + <% +1)), 


(3.4) 
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from the beginning of the analysis. The question we address here is how the space of 
the weights that store D AI is characterized macroscopically when the pattern ratio a = 
M/N ~ 0(1) is fixed as M and N tend to infinity. In order to express this problem in 
the statistical mechanical context, we define the Hamiltonian as 


M 

az{s\d m ) = 

3 = ! 



S-xA 

~7TJ' 


(3.5) 


which counts the number of patterns which are incompatible with the weight S. The 
function Q(x) is the step function where @(x) = 1 (x > 0) and 0(x) =0 otherwise. Using 
the Hamiltonian we can define the partition function 


Z(D m ) = Tre _/3jf,(s|i?M) , 
s 


(3.6) 


The quantity Z(D AI ) varies randomly depending on the quenched randomness D M , which 
naturally leads us to evaluate the generating function 0(n) = (l/lV)log [Z n (D M )] DM , 
where [• • - } d m represents the operation of averaging with respect to D AI . 


3.2 Formalism 


The generating function 0(n) can be evaluated by using the replica method. Following 
the standard prescription of the replica method, we calculate the averaged nth moment 
inn G N 


[Z"W = Tr 


M 


M = 1 3 = 1 


s/N 


(3.7) 


J D M 


where the brackets [• • -] c m denote the average over the quenched randomness D AI . Ac¬ 
cording to eq. (13.3)1 . the variable uj = —yjS M • Xj/^N (p = 1,2,... ,n;j = 1,2,..., M) 
can be regarded as multivariate Gaussian random variable, which is characterized as 


i u j] D M = 0 , [ u j u k] D M = $jk (<W + (1 - , (3-8) 

where q‘ w = (1/JV) Y^=\ (/i, n = 1,2,..., n). This observation yields the following 

expression 


, n M / CM . ™ 

exp(-^E 0 h ^ 

M =1 3 = 1 ' 


s/N 


D M 


f JJ dq^S {S^S U - Nq^ v ) 
J 


exp 


-/?E 6 ' 


vr 


m=i 


M 


(3.9) 


where [• • -] u denotes the average with respect to the multivariate Gaussian variables the 
moments of which are given by eq. (13.8(1 . and the independency of M examples is reflected 
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in eq. (I3.9[) . Using the Fourier expression of the delta function, we get 


\Z n \o M 



d q ^dq^ v 

27T 


exp N 


Y q ,w q IJU + log Tr e^<« ^ S,1SV 

ll<v 


+adog[e 



(3.10) 


where we put a = M/N. Using the saddle point method, we obtain the generating 
function as 

(f>(n, /?) = Extr < — q tJ ‘ v q p ‘ l/ + logTr eZtKu^ lvs>ls '' + ctlog 1 (3.11) 

qiivfpiv I Z— j L J u 

f p<v ) 

where the symbol Extr^ expresses to take the extremization condition with respect to x. 

3.2.1 The replica symmetric solution 

The replica symmetric (RS) ansatz gives 

r u = q, qT = q, (3.12) 


which leads to 


Y qliu y pi ' = 

(3.13) 

^<v 


Tre E M <,^S^ =e -\nq j JJ Z {2 cosh \Z^z) n , 

(3.14) 


where Dz = dze~ z2 1 2 / and we assume that the domain of integration of f Dz is 

] — oo, oo[ if there is no explicit, indication. Under the RS ansatz, the Gaussian variable u M 
can be decomposed to two independent Gaussian variables of zero mean and unit variance 
aU and z as 

= \Jl — qx M + y/qz. (3.15) 

It is easy to check that this assumption satisfies eq. (13.81) . Applying this expression, we 
get 



= f Dz (e-e + (1 - e-0)E (l/^*)) . (3-16) 
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where we define the complementary error function E(x) 



(3.17) 


Note that the relation E(x) + E(—x) = 1 holds. Using the above expressions, we get the 
RS generating function as 


0Rs(n, /3) = Extr<( —~n(n — 1 )qq — -nq + log / Dz{2 cosh y/qz) 7 




+a log / Dz [ Ep 


1-9 


where 


E p (x) = e~ 0 + (1 - e~ 0 )E (x) 
The saddle point conditions yield 

f Dz cosh" yfq.z tanh 2 y/$z 


Q = 


Q = 


cosh" y/qz 

a (1 - e -ey S Dze-ft’’ 

2- 1-9 J Dz (eJ,/^: 


(3.18) 


(3.19) 


(3.20) 

(3.21) 


the detailed derivation of which is given in appendix IA.11 Before discussing the signifi¬ 
cance of the RS solution, we proceed to the replica symmetry breaking (RSB) solution. 
Especially, we utilize the 1RSB ansatz for investigating the complexity and the rate func¬ 
tion in a unified framework. 


3.2.2 The 1RSB solution 

The 1RSB ansatz is expressed as 


(<r,5n = 


(9i? 9i) ( in the same block 

(9o, 9o) ( otherwise ) 


This assumption yields 


y q^T 1 ' = ~n(m - l)gigi + -n{n - m)q 0 q 0 , 




=e"3 n?1 J Dz 0 ^ j Dz x {2 cosh h) m ^j 


n/m 


(3.22) 

(3.23) 

(3.24) 


where h = y/q\ — %Z\ + \Z%z 0 and m is the Parisi’s breaking parameter and expresses 
the size of a block. In the 1RSB ansatz, the Gaussian variable u 11 is decomposed to 


_ U 1,M — v /g 1 _ q oXl + yj\ — q lVfii + 


(3.25) 
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where the variables Xi , y IH , 2 : are drawn from the normal distributions and the index l 
indicates a block and /q specifies a replica in the Zth block. This transformation enables 
us to derive 


[ e -/3E M ©K)j = 


= I Dz (l Dx ^ Es ^ z,x ^ m ') 


nn e -P@(Vqi-qo x i+Vi-<nyvi +V^ Z ) 

1 m 

n/m 


where 


Finally, we get 


/ x / % Q1-Q0 

y 0 {z,x) = - x - - z- J- -x. 

1 - qi V 1 - Qi 


0 irsb (n, m, {5 ) = Extr <( -\n(m - l)qiqi - \n(n - m 
qi,qo,qi,qo I ^ ^ 

n/m 


n/m' 


—-nq\ + log J Dz 0 yj Dzi(2coshh) r 

Ter log J Dzq ^ j Dzi {Ep(y 0 (z 0 , £i))} m ^ 

The saddle point conditions yield the following equations of state 

n/m j (-.Qgpm an h 2 k 


qi — I / Dz 0 I / Dz\ cosh'' 1 h 


f Dz 1 cosh m h 

r _i f n f f n , m ,\ n/m f f DziCOsh™ htanhh\ 2 
qa = I .1 ° Za {.I DZl C ° Sh V { J Dzi cosh m h ) ’ 

’/"* f DzX’f (T 


9i = z - 1 / Dz 0 / Dz x E 


1 - T 




/ 


= 


a 


1- ?i 


J" 1 DzJ DziE, 


i/m I J DZiEp 


m E 'p 


where 


E/ = E/ly 0 (z 0 ,z 1 ))^ dEf{x) 


dx 


I D *i e b 


l-e~P i f2 
-e 2 y o, 


x=yo 




I = / ( / -D^i cosh" 1 h 


I = Dz 0 [ Dz\E 


n/m 


n/m 


(3.26) 

(3.27) 


(3.28) 

(3.29) 

(3.30) 

(3.31) 

(3.32) 

(3.33) 

(3.34) 

(3.35) 


Note that we omit the arguments of Ey(y 0 (zo, z\)) and Ep(yo(zo, z\)) in eqs. fl3.29p ~ fl3.32p . 
Before investigating the equations of state (I3.29p - fl3.32p . we again discuss the physical 
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meaning of the 1RSB formulation for exploring the relation between the concepts of 4>(n), 
£(/), and R(f). 


3.2.3 The complexity and 1RSB formulation revisited 

Two ways of the zero-temperature limit 


Let us focus on the y —)■ 0 (or n —> 0) limit as in section 12.41 Remember that the 
generating function g(x\D M ) of the complexity satisfies the following relation 

e Ng{x\D M ) _ 


dfe 


JV(-/*e/+£(/)) 


(3.36) 


For the perceptron problems, we are mainly interested in the structure of the weight space 
at zero temperature since it directly relates to the learning process of the perceptrons. 

To investigate the weight space, there are two different ways for accessing the limit of 
f3 —* oo. 

One way is to take the /3 —y oo limit with keeping m = x ~ 0(1), and we call this limit 
the entropic limit. For our Hamiltonian (13.5[) . the ground state energy Eqs is given by 0 
or positive constant depending on the sample D M . In such a situation, the xth moment 
of the partition function of pure state 7 , Z x = e~^ x ^ becomes in the f3 —> 00 limit 


f e xs ~< (- u GS = E gs /N = 0) 
\ 0 ( u G s > 0 ) 


(3.37) 


where s 7 is the entropy of the pure state 7 . Hence, this limit enables to investigate the 
weight space structure with ugs — 0 in detail, while it is ill defined for instances with 
uqs > 0. The corresponding generating function becomes 


g(x\D M ) = max {xs + £(s)}. (3.38) 

s-<s<s + 

This entropic limit is appropriate when samples with uqs = 0 are typically produced, 
which corresponds to the low a case. Note that if we want to directly investigate this 
limit we can choose the Boltzmann factor r](S\D AI ) as 

rKS|D") = ne( B „-^), (3.39) 

which is obtained by taking the limit (3 —> 00 in e -/ 3 ^( s 'l- DM ) anc [ j s equal to the number 
of patterns that are incompatible with the weight S. 

The other way is to take the /? —> 00 limit with the m —> 0 limit keeping /3m —)■ £ ~ 
0(1), and we call this limit the energetic limit. Although the entropic limit cannot treat 
instances with ugs > 0, but the energetic limit works well for such instances. For a simple 
explanation, we here use two arguments for the complexity £(w,s). In this notation, the 
generating function g(x\J) becomes 

g(x\D M ) = max{x(s — (3u ) + £(m, s)}. (3.40) 
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If we take the limit (3 —> oo under the condition u > 0, the entropic term becomes 
irrelevant. After that, we take x — > 0 limit keeping fix — > £ and obtain the finite result 

g(€\D M )= max {-£w T E«(m)}, (3.41) 

U-<U<U- 1 - 

where 

Ti u (u) — max £(w,s). (3.42) 

s_<s<s+ 

This limit is appropriate for the case that samples with uqs > 0 typically produced, 
which corresponds to the high a region. In such a region, we can investigate the energy 
landscape by using the energetic limit. 

The two limits, entropic and energetic, are in a complementary relation. Both limits 
can detect the critical capacity a s , below which typical samples are separable (uqs — 0) 
but not separable for a > a s . However, for our present purpose, i.e. to investigate the 
relation among 0(n), £(/), and R(f(n)), the entropic limit is more suitable. We can 
expect that for a > a s behaviors of separable samples which are atypically generated can 
be investigated by introducing the finite replica number n > 0 into the entropic limit, 
which naturally extends the applicable range of this limit. On the other hand, for the 
energetic limit we do not have any clear reason to introduce the finite replica. We can also 
expect that introducing n > 0 into the energetic limit enables to investigate u > 0 region 
for a < a s , but the u > 0 region can also be treated by introducing finite temperature 
T > 0 for the typical case n — 0. Thus, we cannot probably distinguish the effects of 
finite replica n > 0 and of finite temperature T > 0. Hence, we hereafter concentrate on 
the entropic limit. 


The RS and 1RSB solutions in the entropic limit 


The entropic limit is easily taken by performing the limit /? —> oo in eq. (j3.18j) . In this 
limit, there are two solutions for eqs. (I3.20l) - (l3.21jh 
RSI: 0 < q < 1 and q < +oo. 


0rsi (n) = 


n(n — 1) 
2 

To log 


1 

- qq ~ 2 ' 
1 DzE n 


nq + log f / Dz (2 cosh ) 


(3.43) 


RS2: q = 1 and q = Too. 

</>RS2 (n) = (1 - a) log 2. (3.44) 

Similarly, we can find three solutions of the 1RSB saddle-point, equations fl3.29p ~ fl3.32p : 
1RSB1: ( gi , go) = (l,g) and (gi,gb) = (Too,g), where q and q take the same values as 
those for 0 rsi(^)- 

0irsbi (n,m) = 0rsi (—) • (3.45) 

\m/ 
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1RSB2: (qi, q 0 ) = (q, q) and (<fi, <fo) = (q,q), where q and q take the same values as those 
for (f) Rsi(n). 


0irsb2 (n,m) = 0rsi (n). 

1RSB3: (gi,g 0 ) = (1,1) and (gi,g 0 ) = (+oo,+oo). 

0 irsb 3 (n,m) = 0 R S 2 (n) = (1 - a) log 2. 


(3.46) 


(3.47) 


In usual analyses, Parisi’s 1RSB parameter m is determined by the extremum condition 
in evaluating (f>(ri) = Extr m {0irsb*(?T m)}, where * = 1,2 and 3. In addition, there 
might be no need to classify 1RSB2 and 1RSB3 as 1RSB solutions because 1RSB2 
and 1RSB3 are completely reduced to RSI and RS2, respectively. However, handling 
these three solutions as 1RSB solutions with leaving the m-dependence of </>irsb (n,m) 
explicitly, is crucial for the current purpose as we will see in section 13.31 

The formulation relating 4>(ri) and E(s) is easily obtained by following the same dis¬ 
cussion as section 12711 Assuming that the complexity E(s) is a convex upward function, 
we can get the parameterized forms 


s(x) 


d_ f dcj) 1RSB (n,x) 
dx V dn 



E(s(x)) = — x 2 


<9 2 </>irsb {n,x) 
dxdn 


77—0 


(3.48) 

(3.49) 


On the other hand, the relation </>(n) = 0 irsb(^, %)\x=\ a l so holds in the entropic limit. 
This means that the rate function can be assessed from </>irsb(^, as follows: 


SeqPH = 


<90irsb(^, 1) 
dn 


R(s eq (n )) = 0irsb( n, 1) - n 


<9</>irsb(^, 1) 
dn 


where we define the equilibrium value of entropy 


(3.50) 

(3.51) 


s eq = lim lim (1/77) log Z = max (s + E(s)} 

N—>oo (3—>oo s—<s<s+ 


(3.52) 


which corresponds to the total number of weights that are compatible with D M . In eq. 
(13.49(1 . the parameter x can vary only in such a range that both s(x) >0 and E(s(x)) > 0 
hold. Similarly, the conditions s eq (n ) > 0 and R(s eq (n)) < 0 restrict the range of n in eq. 
(13.511) . These constitute the main result of this chapter. 

Here, three issues are noteworthy. First, for a class of disordered systems, includ¬ 
ing the p-spin interacting model without external fields, two equalities 0 irsb (n,m) = 
(n/m)0Rs(m) and </>irsb (n,m = 1) = 0Rs(n), hold in assessing the complexity and rate 
function, respectively, where 0 rs(^) is an identical RS solution of the generating function 
4>{n). Inserting these functions into eqs. (I3.49|) and (13.511) offers an identical functional 
form both for the complexity and the rate function, while their domains of definition are 
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disjointed, except for a point of the typical value of free energy /* (or entropy s*), as 
mentioned in section 12.51 The current system, however, does not possess this property 
because </>irsb (n,m) = (n/m)0Rs(m) does not hold for 1RSB1, 1RSB2, or 1RSB3 
while = 1) = 0rs(u) is always satisfied. Second, eqs. (I3.49P and (13.511) are 

valid only when </>irsb (n,m) are stable against any perturbation for a further RSB. For¬ 
tunately, in the present problem, a stable solution against any known RSB instabilities 
can be constructed for Va > 0 and Vn > 0. This implies that, in the present analysis, 
there is no need to consider further RSB. Finally, however, we have to keep in mind that 
eqs. (I3.49|) and (13.511) depend on the assumptions that correct £(s) and R(s) are convex 
upward functions, respectively. When the convex property does not hold, the estimates of 
eqs. (13.491) and (13.51 jl represent not the correct solution, but rather its convex hull. The 
following analytical and experimental assessment indicates that this is the case for E(s) 
of sufficiently low a and R(s eq ) of sufficiently high a. 

3.3 Theoretical predictions 

We are now ready to use the formalism developed above to analyze the behavior of the 
weight space of the Ising perceptron. 

3.3.1 Complexity for a < a s = 0.833... 

In order to perform the analysis, it is necessary to select a certain solution (functional 
form) among the three candidates of 1RSB1, 1RSB2, and 1RSB3. Analyticity and 
physical plausibility are two guidelines for this task. 

The replica method is a scheme to infer the properties for real replica numbers n6l 
by analytical continuation from those for natural numbers n = 1, 2,... G N. This indicates 
that, for examining typical (n —>■ 0) behavior, it is plausible to select the solution of 0(n) 
that is dominant around n > 1 , because unity is the natural number that is closest to zero. 
For a < a s = 0.833..., this solution is (pRsi( n )- In addition, the relevant </>irsb (n,m) 
must agree with this solution at m — 1. These considerations offer two candidates of g(x) 
as 

Q 

fi'lRSBl(^) = X—4>iRSBl(n, x)\ n=0 = 0RSi(O), (3.53) 

and 

d 

54RSB2 (*e) = 2^01RSB2(n,x)| n=o = £0 RS i(O). (3.54) 

We combine these solutions to construct an entire functional form of g{x) based on 
physical considerations. For x 1, g{x) should vary approximately linearly with respect 
to x, because a single pure state of the largest entropy typically dominates I 11 

addition, s(x) = (d/dx)g(x) for x ~ 0 should be smaller than that for x ^ 1 because s{x) 
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should increase monotonically with respect to x. Furthermore, g(x) must be a continuous 
function. These considerations reasonably yield an entire functional form of g(x) as 


f 0RSl(O); X <1, 
\ ®^si(0), X>1, 

which yields the complexity as 


£( S ) 


^RSl(O) 0 < S < 0Rgi(O), 

—oo, otherwise. 


(3.55) 


(3.56) 


The piecewise linear prohle of eq. (13.55ft is somewhat extraordinary. This is thought 
to be because the correct complexity is not convex upward in this system. When £(s) is 
convex upward, the current formalism using the saddle-point method defines a one-to-one 
map between g(x) and £(s). However, if £(s) is not convex upward, the functional profile 
of a region in which the correct complexity is convex downward is lost and only the convex 
hull is obtained by the transformation from g(x), as shown in figure I33Z1 The piecewise 
linear profile of g{x) presumably signals that this actually occurs in the current problem. 
Similar behavior of the complexity could also be observed in a certain type of random 
energy models |52J. 

The physical implication of eq. (13.561) . the profile of which is obtained by connecting 
two points (s, £) = (O,0' RS 1 (O)) and (</> RS i(0), 0) with a straight line having a slope of 
—x = — 1 , is that the weight space is equally dominated by exponentially many clusters 
of vanishing entropy and a subexponential number of large clusters composed of expo¬ 
nentially many weights. The existence of large clusters may accord with an earlier study 
which reported that local search heuristics of a certain type manage to find a compatible 
weight efficiently up to a considerably large value of a near to the capacity a s (53]. On the 
other hand, the coexisting exponentially many small clusters may be a major origin of a 
known difficulty in finding compatible weights by Monte Carlo sampling schemes [5T1I55] . 


3.3.2 Rate function for a > a s = 0.833... and a transition at 

ct GD = 1.245... 

For a s < a, eq. (13.561) becomes negative, which implies that there exist no compatible 
weights for typical samples of D hI . In such cases, the rate function R(s), which char¬ 
acterizes a small probability that atypical samples that are compatible with the Ising 
perceptrons are generated, becomes relevant in the current analysis. Therefore, we focus 
on the assessment of this exponent for this region. 

For a s < a < «gd = 1.245..., 3rsi(^) dominates the generating function 0(n) in 
the vicinity of n > 1 as for a < a s . This means that 0irsbi (n,m = 1) = </>irsb 2 (n,m = 
1) = 0rsi(h) should be used to assess R(s) of relatively frequent events that correspond 
to 0 < n < 1. However, this function is minimized to a negative value at a certain 
point at which 0 < n s (a) < 1 , which implies that assessment by naively using </>R,si(n) 
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Z(s) 



Figure 3.2: Schematic profile of complexity eq. (13.5611 . The characteristic exponent of the 
size distribution of pure states cannot be correctly assessed in the current formalism if 
it is a convex downward function (dashed curves). In such cases, the complexity £(s) 
assessed from g(x) (solid line) is the convex hull (black circle) of the correct exponent. 


for n < n s (a) leads to incorrect results, which yield a negative equilibrium value of the 
entropy s eq (n) = (d/dn)(ft Rs(n) < 0. In order to avoid this inconsistency, we fix the value 
of 0(n) to (pRsi{n s (a)), which is reduced to the conventional construction of a frozen RSB 
solution. In particular, this yields an assessment of 

R{ 0) = 0rsi (n s (a)) = min{0 RS i(n)}, (3.57) 

n 

which has the physical meaning of a characteristic exponent of a small probability that a 
given sample set D hI is separable by certain Ising perceptrons. For a > «gd = 1-245..., 
on the other hand, the dominant solution of 4>(ri) in the vicinity of n > 1 is updated from 
<t> RSi(n) to 0 RS2 (™) = (!-«) log 2, which yields 

R(0 ) = 0rs 2 (n) = (1 - a) log 2. (3.58) 


In order to provide a visual representation of the above discussions, we depict the behaviors 
of 0(n) in figure 13.31 



Figure 3.3: Behavior of 0(n). The solid lines denote the correct 0(n), and the dotted lines 
are the RS and frozen RSB branches. The corresponding values of the parameter a are 
0.5, 0.95, and 1.4, from left to right. 
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The difference in physical behavior between a s < a < «gd and a > «gd is expected 
to be as follows. For a s < a < ctgd, the dominant solution around n > n s (a), 4>(n ) = 
0rsi (n), varies smoothly. This leads to the following behavior of R(s eq ) in the vicinity of 
s = 0 : 


R(s eq ) = R( 0) - As e 2 q + ..., (3.59) 

where A > 0 is a certain constant, which implies that large clusters can appear with a 
relatively large probability although typical samples of D M are not separable by the Ising 
perceptrons. On the other hand, for a > «gd, 4 >{ n ) = </>rs 2 (n) is constant for n < ugd(«), 
which is characterized by 0 rs 2 (^gd(oO) = 0 Rsi(ncD(«)) and uq d(«) > 1 , and is switched 
to (p(n ) = 0 rsi (n) for n > ncD(«) at n = tigd{o:), which is accompanied by a jump in 
the first derivative. This indicates that the rate function R(s eq ) is not convex upworcl in 
the region of 0 < s eq < (<9/9n)0 R g 1 (nGD(«)) as was mentioned for E(s) in the previous 
subsection, which implies that the events of s e q = 0 overwhelm those of s eq > 0 in relative 
probabilities. Therefore, the generation of large clusters should be considerably rare for 
a of this region. 

3.3.3 Phase diagram on the n-a plane 

The above considerations are sufficient to draw a phase diagram on the n-a plane, which 
is depicted in figure 13.41 


n 



Figure 3.4: Phase diagram on the n-a plane. Solid lines are phase boimdaries, and 
the dotted line denotes n — 1. The dotted-dashed line expresses the AT line for the 
RSI solution, but is irrelevant. The AT line vanishes at a certain value of cc, because the 
solution for 0 < q < 1 vanishes at this point. The RS2 solution involves the AT instability 
only on the n = 0 line, which is presumably of no relevance in the replica analysis. 


The value of the tricritical point ccgd = 1.245... is identical to the critical ratio 
of the perfect learning of the Ising perceptrons in the teacher-student scenario [56,15?]. 
Formally, this agreement is explained as follows. The dominant solution for n < 1 is 
determined by whether 0 rsi(^) or 0 rs 2 (^) dominates around n > 1 . Since 0 rsi(^ = 1) = 
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0RS2 (n = 1) is always guaranteed, the critical condition is given as (<9/<9n)0Rsi(n)| n= i = 
(d/dn)<f)RS 2 (n)\n=i — 0. On the other hand, (d/dri)<f)R S1 (n)| n= i generally provides the 
equilibrium value of entropy after learning in the teacher-student scenario, the target of 
which can be dealt with as an [n + l)-replicated system, in which the teacher is handled 
as an extra replica. Therefore, the condition of perfect learning, which indicates that the 
weight of the student agrees perfectly with that of the teacher after learning, is identical 
to the vanishing entropy condition of the (n + l)-replicated system in the limit n — )■ 0, 
which agrees with (<9/<9n)0Rsi(n)| n= i = 0, giving the critical value «gd in the current 
problem. Although the agreement is justified formally in this manner, its physical impli¬ 
cation remains somewhat unclear. The line n = 1, which passes through the tricritical 
point, may have an analogous relation to the concept of Nishimori’s line in the theory of 
spin glasses [MllSB]- 

Finally, we mention the de Almeida-Thouless (AT) condition in this model [39]. The 
AT (stability) condition of 0 RS (n) with the order parameters q and q is expressed as 
follows: 

a fDzE n ^-(§)^j j Dz cos h ^ 4 y/$z . . 

(1 — q) 2 f DzE n J Dz cosh 71 \J^z 

The derivation is given in appendix IA.21 This condition for 0 rsi( n) is broken in a certain 
region on the n-a plane, but is irrelevant because the region is always included in n < 
n s (a), for which the relevant solution is already switched to that of the frozen RSB. 
On the other hand, 0 rs 2 is stable for n > 0 but becomes unstable only on n — 0, the 
deviation of which is also given in appendix IA.21 as reported in [3jl|• The relevance of 
this instability for a > q:gd may require more detailed discussions, but we assume herein 
that this instability can be ignored because only the asymptotic behavior of in the 
limit n —> 0 is relevant in procedures of the replica method. 

3.4 Numerical validation 

For validating the theoretical predictions obtained in the previous section, we carried out 
extensive numerical experiments. 

In describing the experiments, let us first define the cluster in the present system. The 
cluster is a set of spin configurations that are stable with respect to single spin flips [2H1I29] . 
Clusters have the following properties: 

• Any configuration belongs to a cluster. 

• When a spin configuration “A” can be moved to another configuration “B” by a 
single spin flip without changing the number of incompatible patterns, “A” and “B” 
belong to the same cluster. 


In the following, we concentrate on vanishing energy clusters, which are composed of 
weights that are perfectly compatible with D AI . 








Before going into details, we elucidate the relation between the cluster and the pure 
state. Identifying the microscopic description of a pure state is generally a delicate prob¬ 
lem, but in the Ising perceptron a pure state can be identified with a cluster, as men¬ 
tioned in the opening sentence in this chapter. There is no proof of this statement but 
it is naturally understood by considering the following aspects of the present problem: 
The Boltzmann weight of r](S\D AI ) in eq. (13.39)1 becomes completely zero if there is any 
incompatible pattern. This means that accessing from a cluster to a different cluster by 
single spin flips is impossible because those clusters are completely separated by states 
with zero probability r](S\D AI ) = 0. This naturally leads to identifying a cluster with a 
pure state, because a pure state is a set of configurations which cannot be accessed from 
other sets by natural dynamics. Several earlier studies support this description [2811291150) , 
and we hereafter admit this assumption. 

Now let us return to the experiments. We denote the size of a cluster as Q and the 
number of size-Q clusters for a sample D AI as C(Q\D AI ). The entropy of a cluster s is 
considered to be identified by s = (1 /N) logQ, and the complexity S(s|Zl A/ ) corresponds 
to (1/N) logC(Q\D AI ). The clusters can be numerically evaluated, and hence we can 
construct the 1RSB generating function from the numerical data as 

01RSBnum(n = X 1 J, 171 = x) = ^ log 



where [...] denotes the sample average operation with respect to D AI . In the typical limit 
y —> 0 , this yields the following expression: 


d 

i(x) = lim TT^iRSBnum (xy,x) = 
y^> o ay 


where the step function @(x) comes from the differentiation of log (E 7 Q 7 


1 

0 

v E 7 Qy) log (E 7 Qy) 

N 

0 (e, «;) 



(3.62) 


with 


respect to y. This means that if there is no cluster for a sample D M , then the contribution 


of © (E 7 Qy) log (£7 Q 7 J vanishes. 

In order to examine the consistency with the replica analysis, we assess eq. (13.62(1 based 
on data obtained in extensive numerical experiments. The function (?num(20 is evaluated 
by the exact enumeration of weights that are compatible with D M , which are referred to 
hereinafter as solutions. The procedure is summarized as follows: 


1. Generate M examples D A1 = { ( 2 / 1 , * 1 ) • • • (i/m, x m )}. 

2. Enumerate all solutions. 

3. Partition the solutions into clusters, and calculate E 7 Q* for an appropriate set of 
x. We actually took 41 points between x = 0 and 2.0. 


4. Repeat the above procedures until sufficient data are obtained and calculate 


e (E T 0?) log (e 7 0?) 


by taking the sample average. 
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The resultant plots of g n um(x) for a = 0.5 are shown in fig. 13.51 As the system size 


g(x) 



Figure 3.5: Behavior of g n um(x) for 

a = 0.5. The system sizes are N = 
14,16,18, 20, 22, and 24, from bottom to 
top. The solid lines denote g(x) given 
by eq. ( 13.551) . The number of samples is 
32, 000 for each N. Error bars are smaller 
than the size of markers. As the system 
size grows, the profiles of (? n um(^) approach 
the theoretical prediction. 


g(0) 



Figure 3.6: Size dependence of g n um(0). 
The data are the same as fig. 13.51 The 
solid line is provided by quadratic fitting 
to the data. The point at 1/N = 0 is 
the theoretical value derived by the replica 
method. The data tend to reach this theo¬ 
retical value as the system size grows. 


grows, the numerical data for x < 1 exhibit flatter slopes approaching the theoretical 
prediction g(x) = 0 RS1 (O) for x < 1. This can also be seen in fig. 13.61 as the systematic 
approaching of g num (0) to the theoretical value of g(0) = 0.314 ... derived from the replica 
analysis. The difference between the numerical extrapolation and the analytical result at 
1/N = 0 is considered to be the systematic error due to higher order contributions of 
1/N. The profiles of x > 1, on the other hand, are approximately straight lines, and 
the gradient of the slopes appear smaller than that of the theoretical prediction ^rs^O). 
However, the data still slowly move closer to x0 / RS1 (O) (x > 1) as N becomes larger as a 
whole, implying consistency with the theoretical prediction. 

Complexity £(s) can also be assessed from the numerical data. One scheme for eval¬ 
uating £(s) is to use the relation (13. 49ft with a polynomial interpolation of the numerical 
data. We determined the order of the polynomial using Akaike’s information criteria (SO] 
and eventually selected a 27th degree polynomial, but the obtained results were not so 
sensitive to details of the choice of the polynomial. The assessed profiles of E(s) are plot¬ 
ted in fig. 13.71 The curves appear to approach the line predicted in the previous section 
as N increases, which supports our replica analysis. 

However, the complexity curve shown in fig. 13.71 might lose the information about the 
correct distribution of the clusters, as mentioned in section 13.3.21 In order to examine this 
possibility, we directly evaluate the distribution of pure states in a rather naive manner. 
We refer to the result of this assessment as the raw complexity, which is defined as 

E r (s = (1/A0 log Q\D M ) = 4e (C(Q\D m )) log (C(Q\D m )) . (3.63) 
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I(s) 



Figure 3.7: £(s(x)) obtained from g num (x) using the relation (13.49ft for a = 0.5. The 
system sizes increase from bottom to top. The solid line denotes the asymptotic line in 
the thermodynamic limit predicted by the replica analysis. 


Taking the sample average yields the typical profile of T, r (s\D M ) as £ r (s) = [£ r (s|.D M )], 
the result of which for a = 0.5 is shown in fig. 13.81 We took 32, 000 samples in the 
evaluation for each size and joined the plots to obtain smooth curves. This figure indicates 


2(S) 



Figure 3.8: Plot of the raw complexity 
£ r (s) for a = 0.5. The system size in¬ 
creases from N = 14 to 24 in increments 
of 2, from bottom to top. The solid line is 
the same as that shown in fig. 13.71 


S+Z r (S) 



Figure 3.9: Plot of s + £ r (s). As the sys¬ 
tem size increases, the curve appears to 
converge to a V-shape function, indicating 
that £ r (s) is convex downward. The inset 
shows a close-up of the region enclosed by 
the dotted ellipse. 


that £ r (0) approaches the value of the theoretical prediction </>rsi( 0 )I«=o .5 — 0.314... 
from below as N increases. However, £ r (x) for x > 0.1 appears to remain approximately 
constant at zero, indicating that £ r (x) converges to a convex downward function. We also 
plot the function s+£ r (s) in figure 134)1 This plot shows two peaks and one dip of s + £ r (s), 
indicating that £ r (s) is convex downward. The position of the right-hand peak tends to 
move left to the right terminal point s = 0.314... of the theoretical prediction as the 
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system size increases, while the dip appears to be bounded at the point x = 0.084 as shown 
in the inset. In conclusion, these figures indicate that the exponent that characterizes the 
size distribution of the pure states, £ r (s), is not a convex upward function in this system 
and does not agree with £(s), which is evaluated by the relation (12.521) . 

Next, we assessed the rate function for the region of a > a s . In this region, the 
generation of samples that are perfectly compatible with the Ising perceptrons rarely 
occurs and is dominated by s = 0. Therefore, we numerically evaluated the probability 
that a given set of samples D M could be separated by the Ising perceptron, P sep , and 
estimated -R(O) as -R(O) = (1/IV) logP sep . 



Figure 3.10: Size dependence of the rate 
function for a = 1.0. The point at 1/IV = 0 
is the value predicted by the frozen RSB 
solution. The system size increases from 
N = 12 to 18 in increments of 1. The data 
from 320, 000 samples were evaluated for 
each N. The statistical errors are smaller 
than the markers. 


R(0) 



Figure 3.11: Size dependence of the rate 
function for a = 1.5. The upper and lower 
plots at 1/IV = 0 are given by the RS2 and 
frozen RSB solutions, respectively. The 
system size increases from N = 10 to 18 in 
increments of 2. The data from 25, 600, 000 
samples were evaluated for each N. 


The resultant plots are given in figures [3. 101 and Pi. 11 1 for a = 1.0 and 1.5, respectively. 
The solid lines in these figures were obtained by the linear fitting for the numerical data. 
These figures show that the theoretical predictions are reasonably consistent with the 
values of extrapolation of the numerical data. The statistical errors are sufficiently small, 
and hence the differences between the analytical and numerical results should be the 
systematic errors due to the nonlinearity of the Ising perceptron. 


3.5 Summary 

In this chapter, we investigated the structure of the weight space of Ising perceptrons in 
which a set of random patterns is stored using the derivatives of the generating function of 
the partition function. This was achieved by carrying out a finite-rt replica analysis under 
the assumption of one-step replica symmetry breaking (1RSB) handling Parisi’s 1RSB 
parameter as a control parameter. To directly investigate the weight space structure, we 
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took the zero-temperature limit and studied the entropy of the zero-energy weight. For 
a < a s = 0.833..., the analysis of n — )■ 0 indicates that the characteristic exponent of 
the size distribution of pure states is not convex upward, which implies that the weight 
space is equally dominated by a single large cluster of exponentially many weights and 
exponentially many clusters of a single weight. For a > a s , a set of random patterns is 
rarely compatible with the Ising perceptron. The n —> 0 analysis enables us to assess the 
rate function that characterizes a small probability that a cluster of a given entropy will 
emerge after the storage of random patterns. We found that a cluster of finite entropy 
is generated with a relatively high probability for a s < a < «gd = 1-245..., but this is 
very rare for a > ctgd- These theoretical predictions have been validated by extensive 
numerical experiments. We also drew a complete phase diagram on the n-a plane, in 
which (n, a) = (1, «gd) becomes a tricritical point. The line n — 1 that passes through 
the tricritical point is analogous to the Nishimori line in the theory of spin glasses. 
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Chapter 4 

The replica zeros of ± J Ising spin 
glass at zero temperature 


In the previous chapters, we have seen that the generating function <p{n) shows the an- 
alyticity breaking leading to phase transitions with respect to the replica number n in 
several models. Employing the Parisi scheme and some discussions based on the physical 
plausibility, we have detected such transitions and constructed the reasonable solutions 
after the transitions. These schemes are very powerful and can give physically plausi¬ 
ble predictions, but still involve some questions about the mathematical correctness, as 
pointed out in section 11.41 The possible problems are summarized as follows: 

1. The uniqueness of the analytical continuation from natural to real (or complex) 
numbers. 

2. The consistency between the analytical continuation of (p{n) in the replica prescrip¬ 
tion and the possible analyticity breaking of 0(n) = liiUjv^-oo 

The first problem claims that even if all the moments of [ Z n ] are given for n G N, in 
general it is impossible to uniquely continue the analytical expressions for n 6 N to n 6 R 
(or C). The Carlson’s theorem guarantees that the analytical continuation from n G N to 
n 6 € is uniquely determined if [Z n ] 1//Ar < 0(e 7r l n l) holds as Re(n) tends to infinity [6Tj. 
Unfortunately, the moments of the SK model grow as [Z n ] l / N < 0(e c 'l n l 2 ), where C is a 
constant, and therefore this sufficient condition is not satisfied, van Hennnen and Palmer 
conjectured that the failure of the RS solution of the SK model might be related to this 
issue [62], but as we have seen in chapter 2 this is not the case because 0(n) actually loses 
its analyticity in a certain region of n and T. 

The second issue concerns the possible breaking of the analyticity of </>(n). The naive 
premise of the analytical continuation in the replica theory is the analyticity of (pi v(n) 
with respect to n. However, even if </>jv(n) is analytic with respect to n for finite N, 
the analyticity of <p(n) = hin^^oo 0 jv(n) can be broken, as we have seen in the previous 
chapters. Once the analyticity breaking occurs, in general we cannot depend on the 
analytical continuation from large n to small n to obtain <p{n)\ but the Parisi scheme 
somehow gives the correct behavior of (p{n) by partly utilizing the analytical continuation. 
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The question is how the Parisi scheme overcomes the analyticity breaking and reaches the 
small n region. 

For considering this question, in this chapter, we investigate the analyticity breaking 
of 0(n) with respect to n in completely different ways. To this end, we propose a method 
based on the Lee-Yang theory [26j of phase transitions. In particular, we observe the zeros 
of [Z n ]j with respect to complex n E C, which will be referred to as “replica zeros” (RZs), 
and examine how some sequences of the zeros approach the real axis of n as the system size 
N grows. For some discrete versions of the random energy models [36li63ll65] , this strategy 
is known to successfully characterize the 1RSB transition accompanied by the singularity 
of the rate function R(f) [66j. We extend the scheme to be applicable to other tractable 
systems, ± J models with a symmetric distribution on two types of lattices, ladder systems 
and Cayley trees (CTs) with random fields on the boundary. There are some reasons for 
treating these models. First, these models can be investigated in a feasible computational 
time by the cavity method [MIEIj- Especially, at zero temperature this approach gives 
a simple iterative formula to yield the partition function. Employing the replica method 
and the cavity method, we can perform symbolic calculations of the moment [Z n ]j, which 
enables us to directly solve the equation of RZs [Z n \j = 0. The second reason is the 
existence of the spin-glass phase. It is known that the spin-glass phase is present for 
CTs [T21 do] and is absent for ladder systems. Therefore, we can compare the behavior of 
RZs, which are considered to be dependent on the spin-glass ordering. 

Our result indicates that the RZs of CTs are relevant to neither 1RSB nor FRSB. We 
consider some possible explanations about this fact, and also refer to some relatives of 
CTs, which are considered to show the RSB, to clarify the properties of the relatives from 
the RZs of CTs. 

The results in this chapter are written in reference m- 

4.1 Fundamental knowledge about models and for¬ 
mulations 

We start from reviewing the models and formulations which will be needed in the following 
sections. 

4.1.1 Definition of the Cayley tree and the properties 

The definition of the Cayley tree is summarized as follows: 

• The Cayley tree (CT): A tree of finite size consisting of an origin and its neighbors. 
The first generation is built from c neighbors which are connected to the origin. 
Each site in the gth generation is connected to new c — 1 sites without overlap and 
all these new sites comprise the g + 1th generation. Iterating this procedure to the 
Lth generation, we obtain the CT, and the Lth generation becomes its boundary. 

As an example, we give a picture of a CT in fig. 14.11 Let us consider a general Ising 
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Figure 4.1: A picture of CT with coordination number c = 3 and total generation L — 3. 


system defined on the CT 

'#’=-'52 Jij Si Sj - Y, HA. (4.1) 

ihj) i 

For CTs, it is possible to efficiently assess the partition function by an iterative method, 
i.e. the cavity methoc0. The basis of the cavity method for a CT is a formula for 
evaluating an effective field by a partial trace: 


y^exp {^(JjjSjSj + HA + hjSj)} = Aexp(/3hA)- (4.2) 

Sj 


A simple algebra offers 


hi Hi + hj ( . Jj j , hj ), A ( ' Jj j , hj) 


2 cosh f3 Jij cosh (3hj 
cosh /3hj 


(4.3) 


where 

hj) = tanh -1 (tanh /3 tanh (3hj)■ (4-4) 

The fields hj and hj are sometimes termed the cavity field and cavity bias, respectively. 

For CTs, iterating the above equations from the boundary gives the series of cavity 
fields and biases {hj,hj}- In general, a cavity field becomes a summation of the cavity 
biases from its c — 1 descendants (c is the coordination number): 


C—1 

hi = Hi + y^hj(Jjj, hj). (4.5) 

i =i 

For simplicity, we mainly concentrate on the c = 3 case, the local structure of which is 
given in fig. 14.21 but the generalization to general c is straightforward. Let us denote the 

1 The term ‘cavity method’ is usually used in a different meaning and is considered to be a generalized 
Bethe approximation Esma. Mathematical and physical aspects about the cavity method in this sense 
are very fruitful, but in this thesis we only use this term to indicate the generic name of the iterative 
methods to calculate the partition function. 
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Figure 4.2: Local structure of a CT with coordination number c = 3. 


partition function in the absence of i’s ascendants as Z % . Equations 04.2IMI4.5p imply that 
the partition function is updated as 


Zi= Y. ZjZ k exp{~-(3(—HiSi + AHij + AH ik )}pj(Sj)pk(Sk), (4.6) 

Si,Sj,S k 


where 


Pift) = 


exp ((3hjSj 


(4.7) 


2 cosh /3hj 

is the one-site marginal in the absence of f s ascendants and AH^ = —JijSiSj is the bond 
Hamiltonian added by a propagation procedure. As a final step, the contribution from 
the origin of the tree is calculated as 

Z = Z.Z 2 Z 3 n<2 cosh pj t ) 2 g ° + , (4.8) 


%— 1 


rii=i(2 cosh/3/ij) 


where Hq is the external field on the origin and the whole partition function Z is derived. 

For the sake of simplicity, we consider pure ferromagnets = J and Hi = H for a 
while. In this case each cavity field depends only on the generation g and the recursion 
relation becomes 


h 


9 


H + (c — 1 )hg_l, 



tanh 1 (tanh(/3,7) tanh(/3h 5 _i)) 


(4.9) 


where g is the index of the generation, but for simplicity of notation, we labeled the 
boundary as g = 0 and the origin as g = L, which is in the inverse relation to fig. 14.11 
The partial partition function Z g , which represents the partition function of a branch 
consisting from a (yfth-generation spin and its descendants, is also calculated by 


Z g = ZgZ\ (2 cosh (3,J) 


C— 1 


2 cosh (3h g 


(2 cosh /3h g - i) c_1 


(4.10) 


At the origin, we need to merge c branches, which yields the whole partition function Z 




J L-1 


(2cosh/3J) ol^!M(£±£hul 

(2 cosh (3hL- i) c 


These formulas enable us to efficiently assess the partition function. 


(4.11) 
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4.1.2 Bulk properties of Cayley trees 

Usually, phase transitions are related to the bulk properties of the system. Contributions 
from the boundary condition are negligible and the inside part of the system dominates 
the whole behavior. Unfortunately, this is not the case for a CT, because the CT is ex¬ 
traordinary in that the number of the boundary spins Nb are comparable to the whole 
number of the spins N. Due to this peculiarity, the CTs are known to show some ex¬ 
traordinary critical behaviors [6814717) . This problem may be also interesting but we are 
not involved in this topic. 

On the other hand, considering the bulk part of a CT is also meaningful. For this, we 
define the following two systems which are closely related to CTs: 

• The Bethe lattice (BL): A lattice consisting of the first LI generations of a CT, for 
which L —y oo is taken. Alternatively, we can define a BL as a finite CT of LI 
generation, the boundary condition of which is given by the convergent cavity field 
distribution of the infinite CT. Unlike for a CT, the boundary condition depends 
on the external parameters, e.g. the temperature T and the external held//. 

• The regular random graph (RRG): A randomly generated graph under the constraint 
of a fixed connectivity c. There exist many cycles in this lattice, which makes it 
difficult to calculate the partition function for finite N. In the limit N —> oo under 
appropriate conditions, however, the contribution coming from the loops becomes 
negligible and the RRG becomes an exactly solvable model. Moreover, it is known 
that the RRG and the BL share many identical properties mmm- 

As examples, we give diagrams of a BL and RRG in figs. 14.31 and 14.41 respectively. The 


Figure 4.3: Schematic diagram of a BL with Figure 4.4: A sample of RRG with coordina- 
coordination number c = 3. tion number c = 3 and N = 22. 

RRG is sometimes identified with the BL, but we here distinguish these two systems. 
That is because the main purpose of this chapter is to clarify the asymptotic properties 
of d>Ar(n) from finite N to infinite N , and our definition of the BL is useful to compare 
these limits. Here, the term “RRG” is used only to refer to systems of infinite size. 

A BL is the deep inside part of a CT and the behavior is determined by the limit 
g oo in eq. (14.91) . In this limit, we can easily derive the self-consistent equations 
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satisfied by the converging cavity field h* and bias h* 

h* — H + (c— 1 )h*, h* = — tanh” 1 (tanh(/3 J) tanh(/3h*)), (4-12) 

Note that this equation is identical to the ‘Bethe approximation’. The name of ‘Bethe 
lattice’ comes from this fact that the Bethe approximation is exact on this lattice. When 
the external held is zero H — 0, these self-consistent equations have the paramagnetic 
solution h = 0 at high temperatures and the ferromagnetic solution h > 0 at low tem¬ 
peratures. Expanding eq. (14.121) with respect to h, we can obtain the following equation 
determining the critical temperature 

tarih fjj = -. (4-13) 

c — 1 

For general tree systems, it is known that the free energy can be expressed as the 
following form 130. 3~1 . 4311731 ITol 

(*J> * 

where and is the bond and site contributions of the free energy, respectively and 
Q is the number of bonds that site i has. For regular CTs, c, = c holds if i is inside the 
tree, while c t — 1 for the boundary sites. The explicit forms of f l3 and fi are 


= log ^ exp 3 <j JijSiSj + J Hi + ^ h k j Sj+ Ihj + ^ h k J S 3 l ,(4.15) 
Si,Sj [ \ k&Xi-j J \ keXj-i / J 

- Pfi 1} = logj^exp |/3 j ^ J S'i 1 , (4.16) 

Si l\ keXi ) ) 


where Hi denotes the external held applied on site i and hk denotes the cavity bias. The 
symbol A* denotes the neighbors of site i and A* — j represents the neighbors of site i 
except for site j. These are expressed in the pictorial forms in hgs. 14.51 and 14.61 For pure 



l 




Figure 4.5: A pictorial representation of f l3 Figure 4.6: A pictorial representation of fi 
for c = 3. for c = 3. 

ferromagnets on CTs, the cavity bias takes different values depending on the generation, 
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and we cannot obtain a simple form of the free energy. On the other hand for BLs, the 
cavity bias takes an identical value h*, which leads to the Bethe free energy F/N = f BL 
as 

/ BL = ri+ ^ B -/ (2) - n(c - 1 )/ (1) = nh + r B f B . (4.17) 

t i + r B 

where r\ — (l + c(c — 2)" 1 ((c — l) L '~ l — l)) / (l + c(c — 2) _1 ((c — l) v — l)) and r B = 
1 — r'i represent the fractions of the number of sites inside the tree and on the boundary, 
respectively, and 

/i = |/ (2) - (c- 1)/ (1) , (4.18) 

and 

/b =l/ (2) . (4.19) 

The explicit expressions of bond and site contributions, /^ and are derived from 
eqs. (14.151) and (14.161) . respectively, by putting hi = h*, J = J and Hi = H. These 
formulas give the free energy of the BL. 

Although the uniformness of the cavity fields is recovered in the BL by applying the 
convergent cavity field to the boundary spins, the BL still has a distinctive feature as a tree 
system, which appears in the existence of the boundary free energy (14.191) . Nevertheless, 
the complete separation of contributions between the inside and the boundary in the 
equation (14.17[) implies that it is physically plausible to use /i, instead of / BL , in handling 
problems concerning the bulk part of the CT. In general, f\ agrees with the free energy 
of an RRG which can be derived by using the replica method and the derivation is given 
in appendix IB.11 This fact provides the basis of the correspondence between BLs and 
RRGs. 

Using the relations between CTs, BLs, and RRGs discussed so far, we compare the 
analytical results of RRGs with the numerical plots of RZs of CTs for exploring possible 
links between them. The BL will be also useful to connect those distinctive results. 
According to this advantage, we clearly distinguish the three systems, CTs, BLs, and 
RRGs, throughout this thesis. 

4.1.3 Zeros and singularities 

Phase transitions are generally reflected as the singularities of the free energy —j3f = 
(1/77) log Z. Lee and Yang pointed out that those singularities are related to the zeros 
of the partition function with respect to the complex parameters [26]. For simplicity 
of explanation, let us consider an Ising system with an complex external held H. The 
partition function for finite N becomes the following polynomial 

N 

Z (H) = e NpH tt(k)Y k , (4.20) 

fc =0 
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where fl(fc) is the partition function of the system with the fixed magnetization M = 
Y,iSi = N — 2k, and Y equals to e~ 2l3H . The partition function is the polynomial of Y 
and has its zeros. Of course, these zeros are distributed in the complex H plane and never 
on the real axis of H for finite N. However, as the system size N grows, in several cases 
some sequences of the zeros approaches the real axis, and finally a part of the zeros touch 
the real axis in the limit N —> oo. Roughly speaking, Lee and Yang proved that these 
zeros on the real axis are directly related to the phase transition of the system, and that 
if the zeros never touch the real axis, the system never shows the phase transition. They 
also showed that for several models the existing region of the zeros is strongly limited and 
the phase transitions of those systems are well observed by the behavior of the zeros of Z 
for finite N. 

The discussion by Lee and Yang that the zeros of the partition function are closely 
related to the singularities of log Z is quite general and we can apply this to our problem, 
which motivates us to investigate the RZs given by the equation [Z n ]j = 0 for studying 
the singularities of fi(n) = hnijv-xx^l/^O log [Z n \j 

4.1.4 Energetic zero-temperature limit for replica zeros 

Solving 

[Z n ]j = 0 (4.21) 

with respect to n is our main objective. Unfortunately, this is, in general, a hard task even 
by numerical methods because eq. (14.21)) is a transcendental equation unlike eq. (14.20)) . 
and becomes highly complicated as the system size N grows. In the T — y 0 limit, however, 
the main contributions to the partition function only come from the ground state and eq. 
(14.211) becomes 

[Z n ]j « [<%e-P nE *\j = 0, (4.22) 

where E g is the energy of the ground state and d g is the degeneracy. If n is finite when 

/3 —$■ oo, the term e"^" Ee diverges or vanishes and there is no meaningful result. Therefore, 
we suppose that non-trivial solutions exist only in the limit n —> 0, fi —> oo, and y = fin ~ 
0(1). This is the same limit as the energetic zero temperature limit referred to in section 
13.2.31 Linder this condition, eq. (14.221) becomes 

[e~ yEs ]j = 0. (4.23) 

In the following, we focus on the ±J model whose Hamiltonian is given by 

= (4.24) 

(hi) 

and the distribution of interactions is 

P(J<i) = - 1) + + 1), (4.25) 

assuming that the total number, Nb, of interacting spin pairs (i,j) is proportional to N, 
which is the case for ladder systems and CTs. This limitation restricts the energy of any 
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state to an integer value. As a result, eq. (14.23(1 can always be expressed as a polynomial 
of x = e y , which significantly reduces the numerical cost for searching for RZs. 


4.2 General formula for ladders and Cayley trees 

4.2.1 The cavity method 

We have already demonstrated the cavity method for pure ferromagnetic systems on CTs 
in section 14.11 and we here only give a simple explanation of its generalization to treat 
random systems, k -body interactions, and ladder systems. 

Equations fl4.2jl - fj4.5p are applicable to random systems in the unchanged forms. Gen¬ 
eralizing these equations to fc-spin interacting CTs (A:-CTs) is straightforward; the only 
necessity is to replace the partial trace (14. 2 p with that for a fc-spin interaction, as 


k—1 k —1 


y, exp <1 3 | S t J, ]^[ s y hjSj + HiSi > = Aexp(/3hiSi), 


{Sj} 


j =i j =i 


where 


hi — Hi + hi, A — 


2 k 1 cosh [3Ji n^=i cosh /3hj 


cosh [3 hi 

x _ / fc -' \ 
hi = — tanh 1 I tanh fjJj tanh (3hj I . 

^ V j= i / 

The 3-CT’s local structure with c = 3 is shown in fig. 14.71 as an example. 


(4.26) 


(4.27) 

(4.28) 



Figure 4.7: Local structure of a 3-CT with 
coordination number c = 3. 


Figure 4.8: Local structure of a ladder with 
the width 2. 


For ladder systems, similar relations can be derived with some slight modifications. 
We treat the width 2 ladder as an example. Summation over the two spins of i’s previous 
layer as in fig. 14.81 we can obtain an expression corresponding to eq. (14.2p of the CT as 


y exp{/3(J i _ 1 S‘_ 1 5?_ 1 +A' 1 5J_ 1 5‘+A' 2 Sj_ 1 5?+J - 5; , Sj)} = exp {/?(,/* + 


~* 1,2 


(4.29) 
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From simple algebras we get 



Jj_i( Jj_i, K 1 , K 2 ) = — tanh 1 (tanh (3K ] tanh (3K 2 tanh (3J t _\), 

(4.30) 


.. j cosh (3 Ji_x cosh /3A" 1 cosh / 3K 2 

l, lA , IA ) — 4 ^ , 

cosh (3Ji—i(J i — 1 , AT, K^) 

(4.31) 

which 

means that the effective bonds J* between S( and S 2 becomes 



Ji = J* + Ji-i(Ji-i,K\K 2 ). 

(4.32) 

As eq. 

(]4.6|) in the CT case, the partition function is also updated as 



Zi= E 

(4.33) 

where 

= 40ch^i 

(4.34) 


and AH it i_i = — K 1 Sj_ l S( — K 2 Sf_ 1 Sf — J*S}S 2 is the partial Hamiltonian added by an 
iterative procedure. The above formulas for the CTs and ladders enable us to assess the 
partition function of a given bond configuration {Jij} in a feasible computational cost. 

Taking the T —> 0 limit yields the ground-state energy for a given bond configuration. 
For the c = 3 CT, eqs. (14.4[i and (14. 6 p become 

hj ->■ sgn ( Jijhj ) min(| J tj |, \hj\ ) , (4.35) 

and 


F/j Ej T Efc Jij Jj}~ 

f 0 ( sgn ( JijJikhjh k ) > 0 ) 

\ 2min(| Jijl\Jik\,\ h j\A h k\) ( otherwise ) 


(4.36) 


where we put the ground-state energy as Ei = lim^oo —(1/(3) log Z % and assume sgn (0) = 
0. The extension to general c and fc-body interactions is straightforward and we here omit. 
Similarly, for the ladder, we can derive 


J%—\ -4 sgn (J^K'K 2 ) min(| J^l, \K\ \K 2 \), (4.37) 


and 


Ei = Ei-i - K 1 - K~ - J* 

, / 0 (sgn (J w J-K'K 2 ) > 0 ) 

| 2 min (| «/ i _ 1 |, \J*\, IK 1 ], \K 2 \) (otherwise) • l • J 

For a given single sample of interactions and boundary conditions, a simple application of 
the cavity method enables us to evaluate the partition function in a feasible computational 
time. Unfortunately, this does not fully resolve the problem of the computational cost for 
assessing the moments (I4.2ip since the cost for evaluating the average over all possible 
samples of interactions and boundary conditions grows exponentially with respect to the 
number of spins. 
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4.2.2 Use of the replica method 

To overcome the difficulty mentioned immediately above, we perform the configurational 
average for n G N and use the analytical continuation of the obtained expressions to 
n e C in the level of the cavity recursions, the method of which may be considered as a 
generalization of the replica method. 

For this purpose, we first evaluate the nth moment of the partition function Z 


n = 


\Z n ]j = Tr n 

(*j> L 


exp ( V Sfy" 
/•*=! 


(4.39) 


for n G N, where p is the replica index. Let us denote the effective Hamiltonian as 


H e s Hij n 1°S 


{hi) 


{hi) 


exp ( p J tj s i s j 


M=1 


(4.40) 


J j 


where [• • -]j stands for the configurational average with respect to the interactions { ,J l3 }. 
This means that eq. (14.391) is simply the partition function of an n-replicated system, 
which is defined on the same lattice as the original system, and is free from quenched 
randomness. Therefore, we can again use the cavity method to calculate 5(n). 


The case of the CT 


For the c = 3 CT, we can derive the following recursion relation for S(n) as 


;( v) = 

j &j j 


exp P ( Ja E S < S i + E S ‘ S H 

(1= 1 fl= 1 


PjPk^jynj^kyn) 


n 


(4.41) 

(4.42) 


where pi is the one-site marginal distribution of site i. The expressions (14.41 j) and (I4.42j) 
dehne the updating rules of pi and H i(n). 

So far, we have made no assumptions or approximations and therefore eq. (I4.42|) yields 
exact assessments for n G N, but to practically calculate S(n), we need to specify the form 
of pi. In the present case, the form of pi can be determined as follows. First, we assume 
the RS which requires that the correlation functions are independent of combinations of 
replica indices 

{S}St) K = (S,Kn K = q {2) , (4.43) 

where the brackets ((• • •)) denote the average over the distribution p,. This assumption 
is correct for n G N because the replicated Hamiltonian eq. (14.40(1 is invariant under the 
permutation of the replica indices. Moreover, in our case as long as the number of spins 
N is finite, the RS is exact even for real n G M. This is because the ±J model satisfies 
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the necessary conditions of the Carlson’s theorem [6Tj, as explained in section 14.2.41 With 
the RS, the expression of pi is uniquely determined as 


Pi(Si) = 


E n W) C“l Q a l 

1=0 'U 2^{ ai ...ai} " ' J i 


(4.44) 


where the symbol Xq Q1 a,} stands for a summation over all combinations of / choices from 
n replicas and denotes the correlation functions among l replica spins. It is easy to 
check that the normalization condition is satisfied and all the moments are recovered in 
this expression. Generally, eq. (I4.44|) can be transformed as follows 


/ n 

pm n 

i 


1+iS " W 

2 J 


(4.45) 


where the distribution function Pi(x) must be defined to satisfy relations 

/ x l Pi{x)dx = qp . 


(4.46) 


If \x\ is bounded by 1, the nonnegativity of the distribution p* is satisfied. Under this 
assumption, we can perform a variable transformation x = tanh /3h as 


«= j ^(/o n ( 1+tanl ) wg ) dh = f Vi (h)- 




cosh /3h)' 


-dh. 


(4.47) 


This expression can be interpreted as that the cavity field h fluctuates by the randomness 
and has the distribution 7Tj(h). 

Inserting eq. (I4.47j) into eq. (14.42(1 and performing some simple algebraic steps give 


T: Sj5 fc (2 cosh /3) 2n J dh 


o 0hi £ Si 


X 


5(hi - hj - h k ) 


(2 cosh (3hi) r 
2 cosh /3hi 


'K j (h j )'K k (h k ) 


Y J J dhi^i(hj)-^ 


2 cosh f3hj2 cosh /3h k j 
e P h i E m sf 


dhjdh k 


(2 cosh j3hi) n 

Equations (14.481) and (I4.49p provide the cavity equation of 7Tj(hj): 


Ki(hi) oc / / nj(hj)n k (h k ) 


i(h i -h i -h k )\ — 2c 7 hffli - , Y 

\ 2 cosh /3hj2 cosh (3h k J 


(4.48) 

(4.49) 


dhjdhk , (4.50) 


fc (2cosh f3) 2n // dh j dh k 'K j (hj)'K k (h k ) 


2 cosh /3(hj + h k ) \ 
2 cosh (3hj2 cosh f3h k ) 


J j 


(4.51) 
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which are applicable to Vn e C. When the algorithm reaches the origin of the CT, the 
moment of eq. (14.39j) is assessed as 


x 


(n) = [Z n }j = SiS 2 S 3 (2cosh f3) 3n J jJ dh 1 dh 2 dh 3 n 1 (h 1 )n 2 (h 2 )n 3 (h 3 ) 
1 + tanh (3J\ tanh /3J 2 tanh j3h\ tanh f3h 2 + R' 


(4.52) 


J J 


where R is two terms with the indices 1, 2, 3 rotated. 

The case of the ladder 

For the width-2 ladder, the moment S(n) is updated as 


£ 

s'i.s;-’ 


ex P <,pJ2 (Ji-iSftsK + K'slvl-* + K 2 stVp + rspsp) 

t*= l 


Si- 1) 

^Pi(ShSf) 


J J 

(4.53) 

(4.54) 




These equations also define the recursion rule of the two-site marginal distribution p t ( S \, Sf) 
As in the CT case, we can specify the form of Pi(Sf, Sf) from symmetries of the present 
problem as 


P i(s},sf)= / dJMJi) 


e P J i T,,, 


(4.55) 


(4 cosh (3Ji) n ’ 

which can be interpreted as that the effective bond fluctuates by quenched randomness. 
The equation of the moment E/ then becomes 


1 / dJi—\Tii—\ (t/j_i) 


(4 cosh (5K l cosh j3K 


2 , cosh (3(J* + R- 1 ) 


cosh f3Ji -1 

Equations fl4.53p ~ fl4.55p imply that the recursion relation of 7Tj(Jj) becomes 

cosh fj (,/* + Jj_i) 


(4.56) 


TT^Ji) OC / d</j_i7Tj_i(<7j_i) 


< 5 ( Jr -J*~ Ji-l) 


cosh pji-i 


(4.57) 


These relations yield the algorithm to calculate S(n) for the width-2 ladder. 


4.2.3 Energetic zero-temperature limit in the cavity recursions 

Let us take the energetic zero-temperature limit /3 —y oo, n —> 0 keeping y = /3n ~ 0(1) 
in the iterative procedures of the cavity method. 

We first focus on the width-2 ladder. In our present model, the interaction takes 
±1 with an equal probability 1/2, which means that the initial condition of the recursion 
relation (14.571) . 7r 0 (Jo); takes the following form 

no(Jo) = -(<5(Jo — 1) + S(Jq + 1)), 
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and the initial condition of the moment So becomes in the energetic zero-temperature 
limit as 

S 0 (n) = (2cosh/3) n —> e y . (4.59) 

The relation (14.371) and the fact that | J\j | equals to 1 mean that for \/i J\ only takes hve 
integers 0,±1,±2 at zero temperature. This condition considerably simplify the current 
problem. The cavity equation (14.57)1 becomes 


7 Ti(Ji) OC / Jj_i) 


5(J t -J*- sgn (K 1 K 2 


Xe y(\j*+ S gn(K 1 K 2 J i _ 1 )\-\sgn(K 1 K 2 J^ 1 )\) 

and the distribution 7q(Jj) takes the following form 


, (4.60) 


J j 


~ /) + $(Ji + /))) 

/=1 


(4.61) 


where p L = (pi ; o,Pi;i,Pi; 2 ) represents a probability vector satisfying p i;0 + 2 'YhfPi-J = 1 
and Pi-j > 0. The symmetry p^j = Pi -f comes from the symmetric distribution of { J l3 }. 
Equations (14.601) and (I4.61|) offer the simple recursion equations as follows; 


(Pi;2,Pi;l,Pi;0) « 


(1 -Pi-i-fi) 


) Pi- 1;0) 


(1 -p^ i ;0 )e 



(4.62) 


and the recursion relation of the moment Hj (14.53)1 is also simplified as 


— ^j_ie 3 ^ ^ pi- i ; o + -(1 + e 2y )(l — Pi- i ; o) 


(4.63) 


Equations (14 .62 p and (14.63)) indicate that only p i;0 is relevant for the evaluation of the 
moment. This is a peculiar property to the symmetric distribution of = ±1. We here 
write down the explicit form of the cavity equation of p i;0 


_1 ~ Pi- 1;0_ 

1 - Pi —i* o - (1 + Pi-ip)e 2y ' 


(4.64) 


The formulas (14.63j) and (I4.64p enable us to assess the moment S(?/) in a feasible compu¬ 
tational time and therefore offer a useful scheme for examining the RZs. 

Next, we proceed to the CT case. Unlike the ladder case, for the CT we should choose 
the boundary conditions appropriately. This is because the CT has no cycle in the graph 
and hence the frustration cannot be introduced into the system unless the boundary 
condition is appropriately chosen. 

The boundary condition we here treat is the random external held hi = ±1, the sign 
of which is determined with an equal probability of 1/2. As the result of this boundary 


87 
























condition, the cavity field distribution and the moment at the boundary, 7To(ho) and So, 
become 

^o(ho) = - ( 8(h 0 — 1) + 8(ho + 1)) (4.65) 

and 


S 0 = (2cosh/3) n -> e y , 


(4.66) 


respectively, which yield the initial conditions of the cavity recursions. The relevance of 
the boundary condition to the current objective systems is discussed later. 

Equation (14.65j) in conjunction with the property J tg 1 = 1 again restrict the functional 
form of 7 Ti(hi) in eq. (14.501) as 


C—1 

^Ti(hi) = Pi- 0 5(hi) + y, p,- f (8(hi 
/=i 


f) + 8(h i + f)). 


(4.67) 


The symmetry TTi(hi) = ir^—hi) comes from the symmetry of the boundary-field distri¬ 
bution (14.651) as in the ladder case. 

After the configurational average is performed, the cavity-field distribution 7 Ti(hj) de¬ 
pends only on the distance, g, from the boundary. Therefore, we hereafter denote 7 Ti(hi) as 
7 T g (hi) and represent the distance of the origin from the boundary as g = L. The current 
scheme assesses p g +i using its descendents p g For the c = 3 case, the actual formula is 
derived from eq. (14.501) as 


(Pg+l-,2,Pg+l-l,Pg+l-o) OC > Pgfii 1 ~ Pg-fl), 0 + 2 ^ e 2y \ . 

(4.68) 

Similarly to the ladder case, the relevant part to the assessment of S(n) is only for p g . o, 
the precise recursion relation of which is given by 


Pg+ 1;0 


Pi „ + 2(n£M) 2 e -2 s 

l-2(l-e- 2 ») (T^) 2 ’ 


being accompanied by an update of the moment 



1 — 2(1 — e~ 2y ) 




(4.69) 


(4.70) 


After evaluating p g . 0 and using this algorithm up to g = L — 1, the full moment, S(t/), 
in the current limit n —> 0 and f3 —* oo keeping y = nf3 ~ 0(1) is finally assessed as 


2 ( 1 /) 


773 

“L-l 




1-3(1 



PL- 1 ; o \ 2 
2 ) 


(1 +Pl 



(4.71) 


As eqs. (14.62[) and (14.631) for the ladder case, eqs. (14.691) (14.711) enable us to calculate the 
moment S(r/) in a feasible time, which constitute the main result of this chapter. 

























4.2.4 Uniqueness of the analytic continuation 

The analytical continuation from n £ N to n £ C cannot be determined uniquely in 
general systems. However, in the present system, we can show the uniqueness of the 
continuation. Therefore, the RS solution assumed above is correct. 

For this, let us consider the modified moment [(Ze~^ NB ) n ] l ] N , where Nb is the total 
number of bonds. This quantity satisfies the inequality 


[{z 


0 -PN b \^ V n 


Trl 


')]. 

Re(n) 


< 


l/N 


~/3N B \ Re ( n ) 


(Ze~ f3Nb ) 


l/N 

J 


= 2 Re(n) < 0(e nH ), 


J j 


(4.72) 


for finite N. Suppose that we have an analytic function -0(n; N) that satisfies the condition 
\ip(n;N)\ < 0(e 7r l n l). The Carlson’s theorem guarantees that if the equality |^(n; N) — 
[(Ze~ /3NB ) n ]j N | = 0 holds for Vn £ N, ip(n; N ) is identical to [(Ze~^ NB ) n ]j^ for Vn £ C. 
Because e~^ Ne is a non-vanishing constant, this means that the analytic continuation of 
[Z n ] j /,Y is uniquely determined. This indicates that expressions in the above subsections, 
which analytically continued under the RS ansatz, are correct for finite N (or equivalently, 
finite L). Hence, in the current problem, the possible problem of the analytic continuation 
of 4>(n) = lim^_ > . 00 (l/iV’) log[Z n ]j is summarized into the point whether the analyticity 
breaking on the real axis occurs or not in the limit N —> oo. 


4.3 Results for the ladders 

The concrete procedure to obtain RZs for the width-2 ladder with the length L is sum¬ 
marized as follows: 

1. To obtain a series of p* ; o, eq. (I4.64|i is recursively applied under the initial condition 
R );0 — 0 until i reaches L. This can be symbolically performed by using computer 
algebra systems such as Mathematica. 

2. Using the series {pi-o}, the moment 5* is recursively calculated by using eq. (14.631) 
under the initial condition S 0 = e y until i becomes L. Then, the full moment 
S(y) = El is obtained. 

3. Solving Sl = 0 with respect to x = e y numerically. 

Although the right hand side of eq. (14.641) is expressed as a rational function, the moment 
S(?/) is guaranteed to be certain polynomials of x since the contribution from the denom¬ 
inator is canceled in each step of eqs. (j4.63j) and (I4.64I) . The procedures of 1, 2 and 3 
can be performed in a polynomial time with respect to the number of spins. Figure [4791 
shows the plot for a 2 x L ladder. Notice that all RZs he on a line Im(y) = tt/2. This 
fact can be mathematically proven, as detailed in IB.21 The physical significance of this 
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Figure 4.9: RZs for ladders with 2 x L. All 
the zeros he on Im(y) = 7 t/ 2 and never reach 
the real axis of y — fin. The inequality 
Re(y) < log2y / 2 holds, as shown in appendix 

E2 


Figure 4.10: Zeros of width-4 ladders. Some 
of the zeros approach the real axis around 
Re(y) ~ 1.2 and —0.8, but the rate of ap¬ 
proach rapidly decreases as L grows. 


behavior is that the generating function < 7 ^( 71 ) is analytic with respect to real y even for 
the N —y oo limit. 

We also investigated larger-width ladders. However, the larger-width systems requires 
many-body interactions to calculate the marginal distribution p. It makes the problem 
complicated and simple relations like 114.55(1 cannot be obtained. Hence, when treating 
larger-width ladders, we directly use the cavity method for a given sample { J ig } to obtain 
the ground state energy m, which is just the use of the cavity method we mentioned in 
the end of section 14.2.11 In this prescription, we numerically assess the distribution of the 
ground state energies P(E g ) by enumerating all the bond configurations {Jij}- Using the 
distribution P(E g ), the RZs equation is derived as 

^P(U 5 )e-^ 9 =0. (4.73) 

E g 

This equation is solved numerically in the same way as the width-2 case. Note that com¬ 
putational times required in the counting process to obtain P(E g ) exponentially increases 
as L grows, which makes it infeasible to obtain 5^ for large L , unlike the width-2 case. 

The RZs for 3 x L ladder were calculated and found qualitatively similar results as for 
the width-2 case. For a width-4 ladder, the RZ plot is given in fig. 14.101 We can observe 
that some zeros approach the real axis around R e(y) ~ 1.2 and —0.8, but the rate of 
approach decreases rapidly as L grows. This implies that the RZs do not reach the real 
axis, which agrees with a naive speculation that ladders are essentially one-dimensional 
systems and therefore do not involve any phase transitions as long as the width is kept 
finite. These results indicate that the RZs for the ladders do not reach the real axis of 
y in the limit N —y oo. This means that the analyticity breaking of fi(n) does not occur 
for the ladder systems, which accords with an intuition that the ladders are essentially 
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one-dimensional systems in the thermodynamic limit and should not exhibit the spin-glass 
ordering. 

4.4 Results for the CTs 

As for the ladder case, we first summarize the concrete procedure to obtain RZs for the 
CT: 

1. Recursively applying (14.69(1 under the initial condition po ;0 = 0 until g reaches L — 1 
to obtain the series{p 5;0 }. 

2. The moment is recursively assessed from eq. (I4.70() by using the series {p 9;0 } 
until g becomes L — 1. 

3. The full moment S(r/) = E L is derived from eq. (14.71(1 using S L _i and Pl-i-o 

4. Solving = 0 with respect to x = e y numerically. 

The procedures 1-4 can be performed in a polynomial time with respect to the number 
of spins, which is the same as the ladder case. 

On the other hand, for CTs the number of spins and the degree of the polynomial 
S l increase exponentially as O (((k — l)(c — 1)) L ) as L grows, which makes it infeasible 
to solve S L = 0 for large L. For instance, it is computationally difficult to evaluate RZs 
beyond L = 7 for (k , c) = (2, 3) and L = 4 for (fc, c) = (3,4) by use of today’s computers 
of reasonable performance. This prevents us from accurately examining the convergence 
of RZs to the real axis in the limit L —> oo by means of numerical methods. 

However, the data of small L still strongly indicate that the qualitative behavior of RZs 
can be classified distinctly depending on whether certain bifurcations occur for the cavity 
held distribution in the limit of L —> oo, which implies that the RZs of the CTs reflect 
the phase transitions with respect to y. Unfortunately, we also clarify that the transitions 
are related to no RSB by some analytical discussions. In the following subsections, we 
give detailed discussions to lead this conclusion presenting plots of RZs. 

4.4.1 Plots of the replica zeros for CTs 

We here present the results for CTs. The plots for a CT and for a 3-CT with c = 3 are 
shown in hgs. l4.lll and l4.l21 respectively, ft is known that the FRSB and 1RSB transitions 
occur in RRGs with ( k,c ) = (2,3) and (k, c) = (3,3), respectively [ lQl[301 [721 177] , 

Figure 14.111 shows that RZs of the c = 3 CT lie on a line Irn(y) = 7 t/ 2. Interestingly, 
this behavior is the same as the 2 x L ladder case in hg. 14.91 This result indicates that 
there is no phase transition or breaking of analyticity of </>(n) with respect to real y. This 
strongly suggests that the RZs of CTs cannot detect the FRSB transitions in RRGs. 

On the other hand, for the 3-CT case in hg. 14.121 a sequence of RZs approaches a point 
y c on the real axis from the line Im(y) = n/2 as the number of generations L increases, 
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Figure 4.11: Plot of RZs for a CT with c = 3. 
All the zeros lie on the line Im(y) = tt/2, as 
for a 2 x L ladder. 


Figure 4.12: RZs plot for a 3-CT with c = 3. 
A sequence of zeros approaches the real axis 
as the number of generations L increases. 
The arrow indicates the collision point ex¬ 
pected from the study of the L —> oo limit in 
section 14.4.21 


although the value of y c is far from y s = oo where the corresponding RRG occurs the 
1RSB transition. The arrow in fig. 14.121 represents the speculated value of y c from the 
analysis of the corresponding BL, the detail of which is given in the next subsection. 

A similar tendency is also observed for a CT and 3-CT with c = 4, plots of which are 
presented in figs. 14.131 and 14.141 respectively. The 1RSB critical values are y s = 0.38926 
for the CT and y s = 1.41152 for the 3-CT. Again, these values are far from the values of 
y c , which can be observed in figs. 14.131 and 14.141 

These results indicate that certain phase transitions occur for some CTs, although 
they are irrelevant to 1RSB and FRSB. It is difficult to identify the critical value y c from 
the plots because of the computational limits. Instead, in the following subsection we 
investigate the L —)■ oo limit of these models. The arrows in figs. 14.12114.1T1 represent the 
transition points y c determined by this investigation. 

4.4.2 The thermodynamic limit and phase transitions of BLs 

In order to identify the value of y c , we here consider the thermodynamic limit. Direct 
investigation of CTs in this limit is difficult, and we employ BLs to speculate the behavior 
of CTs. 

Transitions of the convergent cavity-field distribution 

The first step is to take the L —> oo limit by equating p g+ 1 ;0 and p g . 0 in the iterative 
equation of p g - o, which yields the boundary condition p* of the BL. For a c = 3 3-CT, the 
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Figure 4.13: RZs of a CT with c = 4. We 
consider only an L-generation branch in this 
case because of computational limits. RZs 
approach the real axis as L increases around 
y c ~ 0.5. The arrow indicates the location 
of the singularity of the cavity-field distribu¬ 
tion. 



Figure 4.14: RZs of a 3-CT with c = 4. We 
consider only an L-generation branch. The 
zeros approach the real axis around y c ~ 1.1. 
There are two singular points of the cavity 
field distribution in this case, both of which 
are indicated by arrows. 


iterative equation is given by 


Pg+ 1;0 


{pI 0 + 2 Pg;o( 1 - Pg-, o)} 2 + je 2y (l - p g;0 ) 4 


(4.74) 


A return map of the recursion of p g; o and the convergent solution p* in the initial condition 
Po ; o — 0 are presented in figs. 14.151 and 14.161 respectively. The return map shows that 
there are three fixed points for x > 2.35, while p = 1 is the only fixed point for x < 2.35. 
This situation is in contrast to the c = 3 CT case, in which the cavity-field distribution 
uniformly converges to an analytic function: 


2 + x 2 — \Jx A + 8x 2 
2(1 — x 2 ) 


(4.75) 


which can be derived from eq. (I4.69[) . This implies that when eq. (14.65(1 is put on the 
boundary of the CT, the boundary condition of the BL, which was obtained by an infinite 
number of recursions L — L' —y oo, exhibits a discontinuous transition from p* < 1 to 
p* = 1 at x ~ 2.35 y c ~ 0.86 as y is reduced from the above. Actually, in fig. 14.121 RZs 
of the c = 3 3-CT seem to approach y c rs 0.86, marked by an arrow. This indicates that 
RZs obtained by our framework are relevant to the phase transition of the boundary of a 
BL, which is not related to 1RSB. This can be also confirmed from the initial condition 
dependence of the RZs behavior. Equation (14.74jl implies that the fixed point p = 1 is 
always stable, which can be seen from fig. 14.151 and a sufficiently large initial condition 
Po ; o > 0 leads to the convergence to this fixed point. In that case, it is reasonable that RZs 
do not approach the real axis of y. The actual plot of RZs for a c = 3 3-CT with the initial 
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Figure 4.15: Return map of a 3-CT with 
c = 3. The convergent point of the recur¬ 
sion discontinuously changes depending on 
x. The solid line represents the function 
f(p) = P- 


Figure 4.16: Asymptotic behavior of p g -o of a 
3-CT with c = 3. A finite jump of p occurs at 
x ~ 2.35. The solid line denotes the L —y oo 
solution p*. 


Inn[y] 



Figure 4.17: Plot of RZs of a c = 3 3-CT with the initial condition po-o = 1/2. The RZs 
do not approach the real axis even as L grows. 


condition p 0 . 0 = 1/2 is given in fig. 14.171 This figure clearly shows that the RZs do not 
approach the real axis. It can be also observed that as the initial condition po ; o becomes 
close to 1, RZs tend to go to the limit R e(y) —> — oo and Irn(p) = 7 t/ 2, and become to 
never approach the real axis. These observations support the present description that the 
RZs of CTs correspond to the transition at the boundary of BLs. 

The same analysis for a c = 4 CT shows that bifurcation of another type can occur 
for even c. For this model, the recursive equation of p g - 0 has a trivial solution p* = 0 
for \/x, which is always the case when c — 1 is odd. The return map and plots of p* 
are shown in figs. 14.181 and 14.191 respectively. These figures indicate that there exists a 
continuous transition from p* = 0 to p* > 0 at a certain value of x, which can be assessed 
as x c = \/3 0.5. This is consistent with a certain sequence of RZs approaching 

the real axis around y c ~ 0.5 in fig. 14.131 which supports the analytical assessment of the 
critical points. 
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Figure 4.18: Return map of a CT with c = 4. 
The stable fixed point is unique but shows a 
singularity at x = e y = \f?i. 


Figure 4.19: Asymptotic behavior of p g .o of a 
CT with c = 4. In the thermodynamic limit, 
p g .o is continuous but the derivative becomes 
discontinuous at x — y/3. 


In general, the discontinuous transition appears for cases of k > 3 spin interactions 
and the continuous transition occurs when c is even. Actually, for a c = 4 3-CT, both 
discontinuous and continuous transitions occur at x ~ 0.86 =>- y ~ —0.15 and x = 3 =>■ 
y ~ 1.1, respectively. Figure 14. 141 shows a sequence of RZs approaching y fz 1.1, while it 
is difficult to clearly identify a sequence converging to the other critical point y ~ —0.15. 
We consider that this is because the system size is not large enough, since a portion of 
the RZs in the left shows a tendency to approach the real axis, though further increase of 
the system size is practically unfeasible due to the limitations of current computational 
resources. 

In conclusion, the RZs of CTs are related to the phase transitions on the boundary of 
the corresponding BLs. Regardless of the type of transition, a sequence of RZs approaches 
a critical point on the real axis when the BL provided from a CT in the limit L —» oo 
exhibits a phase transition on the boundary. 

Relevance of the boundary condition and bulk properties of CTs 

Equations 114 .6 911 — 114. 71 li imply that the generating function (j>N(y ) = logS(p) for CTs 
can also be separated into the bond and site contributions as eq. (j4. 14jl in the case of free 
energy 

My) = - ~ 1 )^- 1 ) ( 2 /)- ( 4 - 76 ) 

<h'> i 

As discussed in section 14.1.21 for a BL, the boundary condition given by the convergent 
solution of eq. 114.6911 . p*, which becomes a function of y, simplifies the expression of eq. 
(14.7611 as 


i ffi(y ) = nMv) + (y). 


(4.77) 
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and 


(4.78) 

(4.79) 


Mv) = ^M\y) - (c -1)</> (1) (2/)> 
<fa(y) = 


where 4>i(y) and 4>b{v) represent contributions from a site inside the tree and on the 
boundary, respectively. In general, M\y) and MKv) are expressed as 


M\y) = log {Tr \p(S l ) c - l p{S 2 ) c ~ 1 e pJ ^ s " s ^ 


where 


<l> m (y) = log {a p(sy}, 


p(S) = / dhrr^h)- 




(2 cosh /3h) n 

and 7r (h) is the distribution of the cavity bias, which is related to n(h) as 
tt( h) = I dhn{h) 5 — — tanh _1 (tanh/3Jtanh/3/i) 


(4.80) 

(4.81) 


(4.82) 


(4.83) 


These can be interpreted that cavity biases fluctuate due to the average over the quenched 
randomness. These formulas are generalizations of eqs. (l4.14jMI4.16p to the generating 
function 4>(n). For c = 3 in the limit (3n —> y, we have 


M\y) = loge y ^l-i(l-e 2y )(l ~P*) 2 ^j , 

(4.84) 

M\y) = log (l - |(1 - e _2y )(l -p*) 2 (l +p*)^ • 

(4.85) 


In general, 4>i(y) agrees with 4>(y) of an RRG, which is the same as the free energy case. 

In spin-glass problems on cycle-free graphs, the replacement of (ffi(y) with (j>i(y) is 
crucial. To see this, let us investigate the rate function R(f) as in section 1231 We denote 
the boundary condition as P B (h) = Ilieboundary MM- Since CTs and BLs have no cycle, 
for the ±J model defined on those lattices the boundary condition is the only relevant 
factor determining the property of the model. Combining this fact with eq. (14.231) . we 
can express the moment S(?/) of CTs and BLs as 

S( y) = I dhP B (h ) exp (- yE g (h )), (4.86) 


where E g (h ) is the ground state energy when h is imposed on the boundary. This yields 
the following equation with respect to the rate function for finite N, R^iy), 


. . 2 d 

Mv) = y 



i 

N 


dhP B (h ) log 


PpJh) 

Ps(h) 


—D(P b \P b ) > 0, 


(4.87) 
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where we define the probability distribution Pb(^) as Pb{R) = Pb(^) exp (—yE g (h)) /E(y) 
and introduce the so-called Kullback-Leibler (KL) divergence P(P b |Pb) between P B (fo) 
and Ps(h), which takes a positive value unless Pb(/i) becomes identical to Pb(^-)- This 
equation guarantees the non-positivity of the rate function R N (y). The constraint Pv(/) < 
0 is always satisfied even when N —> oo. However, as discussed in section [2751 this is not 
necessarily the case when we first take the thermodynamic limit limjv-Kjo <Azv(z/) = </>(?/) 
and then calculate the rate function by using the analytically continued <j)(y) as R(y) = 
—y 2 (d/dy) (|/~ 1 0(|/)). This function R(y) can be positive, and the condition R(y s ) = 0 
signals the onset of 1RSB as shown in section 1231 

The condition R(y s ) = 0 has already been investigated for RRGs and indicates that 
1RSB transitions occur for some types of RRGs [T01 I72]. However, it is considered that 
such a symmetry breaking cannot be detected by an investigation based on eqs. (14.69j) 
(14.71(1 because the boundary contribution is inevitably taken into account for a BL as well 
as for a CT. 

An example will clearly illustrate this point. Let us calculate the generating function 
of the c = 3 BL and RRG. The generating function of the RRG (assessed only in the 
thermodynamic limit) is given by substituting eqs. (14.69(1 . (14.84(1 . and (14.85(1 into (fti(y), 
and the plot is given in fig. 14.201 This shows a 1RSB critical value R(y s ) = 0 at y s = 

R(y) R(y) 




Figure 4.20: The rate function of a c = Figure 4.21: The rate function of a c = 3 BL 
3 RRG. The 1RSB critical value is y s = in the limit L —> oo. The constraint R(f) < 
0.41741. 0 is completely held. 

0.41741 and demonstrates the failure of the analytic continuation of 4>(y). On the other 
hand, the generating function of the BL for finite N is given by eq. (14.77(1 with the 
conditions (14.69(1 . (14.84(1 . and (14.85(1 . Clearly, the ^dependence of (j)^ L (y ) only appears in 
two factors r\ — (l + c(c — 2) -1 ((c — l)^” 1 — l)) / (l + c(c — 2)” 1 ((c — 1) L ' — l)) and 
tb = 1 — ri through the total generation L. These factors are analytic with respect 
to L even in the limit L —> oo, which guarantees the uniform convergence of ^ L (y) 
to lim l^-oo (pL h {y) = (p BL (y)- Hence, the analytic continuation of cj)(y) is successfully 
performed and the resultant rate function P(/) never violates P(/) < 0, which can be 
actually seen in fig. 14.211 Also, we can prove the absence of the 1RSB transition for CTs 
by showing the uniform convergence of 0 at(|/). We succeeded to prove this for a c = 3 CT 
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and the details are shown in appendix IB. 31 

In summary, the RZs of CTs provided by the current scheme are irrelevant to the 1RSB 
because it does not appear in BLs and CTs due to the huge boundary effect. However, 
this does not mean the absence of another RSG, FRSB, in BLs and CTs. Next we examine 
this point. 


4.4.3 Possibility of the full-step replica symmetry breaking 


The AT condition, which is critical for the FRSB, has not yet been characterized for 
sparsely connected spin models [ZZHZ2]. In fact, a previous research has found that critical 
values of the continuous transitions from p* = 0 to p* > 0 are candidates for those of the 
AT condition for systems of even c [TO] , This motivates us to further explore a possible 
link between RZs and the AT instability. 

As discussed in section 12.6.11 the AT condition is identical to the divergence of the 
spin-glass susceptibility xsg in the fully-connected p-spin interacting model. Hence, it is 
reasonable to adopt the divergence of \SG as the critical condition of the FRSB for BLs 
and RRGs [801182] . Using the (statistical) uniformness of BLs and RRGs, it is sufficient 
to see the susceptibility of only the root site 0. The spin-glass susceptibility of BLs for 
finite replica n is generally written as 



(4.88) 


where [(• • • )] n means an average with respect to a modified distribution of coupling and 
boundary field 


Pn({J «}, {A.}) 


pgjj j}, (ftj) 

E w ,}ft’(^},{ft.})Z"(«j},{ft.})' 


(4.89) 


In a cycle-free graph, an arbitrary pair of nodes is connected by a single path. Let us 
assign node indices from the origin of the graph 0 to a node of distance G along the path 
as g — 1, 2,..., G. For a fixed set of couplings and boundary fields, the chain rule of the 
derivative operation indicates that 


d(S 0 ) 

dh G 


d (S Q ) dh 0 dh 0 dh G 
dh 0 Qh 0 9h 1 dh G 

d (So) - 1 -r dhg_i 

dh 0 g=l dh g 


d (S 0 ) dh 0 -p-r dhg-i dhg 
dh o dh 0 g=1 dh g dhg 


(4.90) 


as h g depends linearly on h g as h g = h g + r g , where r g represents a sum of the cavity 
biases from other branches that flow into node g. For a BL of (k,c) = (2,3), the cavity 
equation yields an evolution equation of the cavity bias 


h g _i = — tanh (tanh (/3J g ) tanh (/3(h g + r g )) 
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(4.91) 




sgn (jgihg + Tgfj 

Jg(hg + Tg) 


( \hg + r g I > 1 ) 
( otherwise ) 


(fl-too), 


where J g denotes the coupling between nodes g — 1 and g, and similarly for other cases. 

To assess eq. 04.881) . we take an average of the square of eq. 04.901) with respect to the 
modified distribution P n ({ Jp}, {hi}). Here, r g can be regarded as a sample of a stationary 
distribution determined by the convergent solution of eq. 04.691) for the BL. As r g is limited 
to being an integer and \J g \ = 1, eq. 04.91 j) gives 



0 

0 or 1 
1 


( \hg + r g\ > 1 ) 

( I hg + Tg | = 1 ) , 

( otherwise ) 


(4.92) 


where the value of 0 or 1 for the case of \h g + r g \ = 1 is determined depending on the 
value of h g . When h g eqauls 0 (and \r g \ = 1 ), the values 0 and 1 are chosen with equal 
probability 1/2 since the sign of the infinitesimal fluctuation of h g , Sh gi is determined in 
an unbiased manner due to the mirror symmetry of the distribution of couplings. On the 
other hand, under the condition of Y^k= g +\ dhk-i/dhk ^ 0, the case of \h g \ — 1 (and 

r g = 0) always yields dh g -\/dh g = 1. This is because h g 5h g < 0 is guaranteed for 
\h g \ = 1 under this condition. 

Equation (14.921) indicates that the assessment of eq. (|4.90|) is analogous to an anal¬ 
ysis of a random-walk which is bounded by absorbing walls. We denote by P( G _>o) the 


probability that 


of n 9= i | dh g _i/dh g \ is kept to unity. This indicates that 


dhg-l/dhg 


never vanishes during the walk from G to 0 and the value 


d(S 0 ) 


dh 


G 


OC Pi 


(G-> 0) 


(4.93) 


holds. Summing all contributions up to the boundary of the BL yields the expression 


L' 

XSG oc J^(fc - l) G (c - 1 ) g P (g ^0)- (4.94) 

G= 0 

The critical condition for convergence of eq. (14.94)) in the limit L' — > oo is 

log ((* - 1 )(c - 1)) + lim ^ logP (G ^ 0 ) = 0. (4.95) 

G—>CXD G 

This serves as the “AT” condition in the current framework. 

For a BL, eq. (j4.95j) can be assessed by analyzing the random walk problem of eq. 
(14.92)) . as shown in appendix IB.41 We evaluated the critical hat values of eq. (14.95)) for 
several pairs of ( k,c ), shown in Table ITT! along with other critical values. These results 
show that the values of y c , which signal the phase transitions of the boundary condition 
of the BL, agree with neither i/at or y s for c = 3 implying irrelevance of RZs of CTs to 
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(k,c) 

Vat 

Vc 

Vs 

(2.3) 

0.54397 

none 

0.41741 

(2,4) 

0.54931 

log ^3 w 0.54931 

0.38926 

(3,3) 

1.51641 

0.85545 

oo 

(3,4) 

1.09861 

-0.15082, log 3 « 1.09861 

1.41152 


Table 4.1: Relevant values of y. Note that each kind of y is calculated using different 
models. The 1RSB transition point y s is for RRGs and y^T is for RRGs or BLs. The 
singularity of the cavity-field distribution y c is common for all the models. Note that the 
value of yAT in the case (k, c ) = (3, 4) is the same as the one in pH] . 


the replica symmetry breaking, while for c = 4 the values yAT and y c agree each other. 
We consider that the correspondence for the c = 4 cases is accidental since the case 
(k, c ) = (2, 3) offers strong evidence that the AT instability cannot be detected by the 
current RZs. This point may require more detailed discussions but we here leave it as a 
future work. 

To investigate the irrelevance of RZs to the AT instability further, let us examine the 
singularities of RZs of a (k, c) = (2, 3) BL. The moment of the BL for finite generation 
L', S/y(?/), is easily derived from eqs. (14.70j) . (14 .71 1) and (14. 751) . and the result is 


-‘U 


(y) = 


^3-2 L 

^0 


X 




3-(2 i '- 1 -l) 


X 


+ -(1 -x 2 )(l -p*) 2 (l + p*) 


(4.96) 

where S 0 = p* + xp\ + x 2 pl is the moment of a boundary spin, and the quantities p\ and pi 
represent the probabilities that the convergent cavity field takes ±1 and ±2, respectively. 
The explicit forms of pi and p\ are obtained from eq. (14.681) 


(pip 1 *) 


2 

2 — (1 — p*) 2 (l — x~ 2 ) 




The RZs of the BL is easily derived as 

Z L (y) = 0 =► y = ±^z, 0.369207 ± 1.02419*, 0.23664 ± 1.8059R. 


(4.97) 


(4.98) 


This result implies that RZs of BLs are also irrelevant to the FRSB, because there is no 
RZ on the real axis of y. 

The irrelevance of RZs to the AT instability may be interpreted as follows. Remember 
the discussions given in section 12.6.11 We can link the spin-glass susceptibility to 0w(^) 
by considering the modified generating function 


N(j) N (n, m, F ) = 


log 


N 


Tr exp \-j) ^ H (S“) + £ F, £ S,“Sf (Tr 


a= 1 


1=1 a<b 




, (4.99) 
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in which the interaction F = (F \, F 2 ,, F/v) are introduced among m out of n replica 
systems. Analytically continuing eq. (14.99j) to n,m E M. and expanding the obtained 
expression around F = 0 for m ~ 1 yield 

^ / n ,_ 1 . ^ yu _ 1 

N(j) N (F;m,n ) ~ Ncj) N (n) H--— q F t H--— F t xsgF + (higher orders), (4.100) 

i 

where xsg = ([((S)Sfc) — (Si) (S'*,)) 2 ] ) represents the spin-glass susceptibility matrix. 
Equation (j4.100jl implies that the divergence of the spin-glass susceptibility is linked to 
analytical singularities of hniAr-^oo 0Ar(n, m, F) for m ^ 1. However, for m — 1, which 
corresponds to 0v(^) examined in this chapter, it is difficult to detect the singularity be¬ 
cause the factor m — 1 with F t xsgF makes the divergence of the spin-glass susceptibility 
irrelevant to the analyticity breaking of 4>(n) = Hiun^oo 4>n(ti) . This explains the irrel¬ 
evance of the RZs to the AT instability in the current framework. Considering systems 
of m ^ 1 may enable us to detect the AT instability by the RZs formula, but such an 
investigation is beyond the current purpose and we leave it as a future work. 


4.4.4 Physical implications of the obtained solutions 


We concluded that bifurcations of the fixed point solutions of the cavity-field equation 
correspond to phase transitions of the boundary condition of a BL and are not relevant 
to either 1RSB or FRSB. Before closing this section, we discuss the physical implications 
of the obtained solutions. 

A naive consideration finds that the solution of Poo -o = P* = 1 corresponds to a param¬ 
agnetic phase implying that any cavity fields vanish and therefore all spin configurations 
are equally generated. Note that this phase is of the ground states in the limit /? —> oo 
and is different from the usual temperature-induced phase. 

For finite p* < 1, relevant fractions of the spins can take any direction without energy 
cost because the cavity field on the site is 0. This implies that the ground state energy 
is highly degenerate, which means that this solution describes a RS spin-glass phase. 
Actually, it is easy to confirm that the following equality holds: 

[Tr SjjSZe-^n^j 


= 


[Z r 


= TvSi;s"p g (s) = i- Pg . fi 


(4.101) 


Hence, the singularity of the cavity-field distribution in the limit g —> oo can be regarded 
as the transition of the spin-glass order-parameter. A finite jump of p* for the k = 3 
case is the first-order transition from the RS spin glass to paramagnetic phases, and such 
a transition is also observed in the mean-field models. The transitions from p* = 0 to 
fmite-p* for the c = 4 case can be regarded as a saturation of q to Qea = 1- We infer 
that these are the transitions from RS to RS phases. Notice that such a transition has 
not been observed for infinite-range models. Our results indicate that this q = 1 phase 
appears only when c is even. This means that such a phase is highly sensitive to the 
geometry of the objective lattice. This may be a reason why such a transition has not 
been observed in other models. 
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4.5 RZs for RRGs 


In section 14. 4. 31 we have investigated the AT instability for BLs and RRGs and concluded 
that the instability cannot be detected by RZs of CTs and BLs. We have also inferred 
that the AT instability is difficult to observe in the systems without interactions among 
replicas. To examine this proposition, we present RZs for c = 3 RRGs in this section. 

Constructing the RZ equation [Z n ]j = 0 for a RRG is a rather involved work because 
the average [(• • •)] j requires not only the calculations of configurations of Jij = ±1 but also 
the geometrical structure of the graph. To overcome this difficulty, we fix a geometrical 
structure and only treat the configurations of the bond value = ±1 when constructing 
the RZ equation [Z n \j = 0. This prescription is not faithful to the definition of the RRG 
but we can expect that gaps coming from the difference of the definitions vanish in the 
thermodynamic limit. 

Actual procedures we performed for calculating the RZs of RRGs are rather simple: 

1. Generate a c = 3 RRG with a size N. 

2. Set a bond configuration J and calculate the ground-state energy by exploring all 
the spin configurations. 

3. Continue the procedure 2 until all the bond configurations are completed and make 
the distribution of the ground-state energy P(E g ). 

4. Construct the RZ equation ^2 Eg P{E g )e~ yEa = 0 and solve it. 

5. Generate other RRGs with the same size N and compare the results (actually we 
generate 16 samples for a size). 

Clearly, these procedures require huge computational times, which makes it infeasible to 
calculate for A^ > 16. 

Some typical behavior of RZs of RRGs for the sizes AI = 14 and 16 are given in 
figs. 14.221 and 14.231 respectively. We can see that the RZs lie on the line Im(y) = m/2 for 
N = 14. Actually for N < 14, we could not find any samples which show RZs approaching 
to the real axis. For the N = 16 case, some sequences of the zeros exist apart from the line 
Im(y) = m/2. This result implies that RZs of RRGs approach the real axis as the system 
size grows, which may signal the AT instability of the RRGs. However, it is difficult to 
draw any distinct conclusion from figs. 14.221 and 14.231 because the system sizes are not 
sufficiently large. For further investigation, we need some other idea to overcome the 
computational difficulty of large systems, and leave this problem as a future work. 

4.6 Summary 

In this chapter, we have investigated RZs for CTs and ladders in the limit T, n —> 0, /3n —>■ 
y ~ 0(1). Most of the zeros exist near the line Im(y) = n/2 in all cases investigated; 
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Figure 4.22: Plot of RZs for five samples of 
c = 3 RRG of the size N = 14. All of the 
RZs lie on the line Im(y) = in/2. 


Figure 4.23: Plot of RZs for five samples of 
c = 3 RRG of the size N = 16. For some 
samples, some sequences of the zeros exist 
apart from the line Im(y) = in/2. 


in particular, for the (k, c ) = (2, 3) CT and the width-2 ladder all the zeros lie on this 
line. For the width-2 ladder we have proved that the generating function is analytic with 
respect to y in this model. On the other hand, for some CTs, a relevant fraction of 
the RZs spreads away from the line Im(y) = n/2 and approaches the real axis as the 
generation number L grows. This implies that 4>(n) has a singularity at a finite real 
y in the thermodynamic limit. A naive observation finds that the RZs collision points 
correspond to phase transitions of the boundary condition of the BL. We have compared 
them with known critical conditions of the 1RSB and FRSB and concluded that these 
conditions are irrelevant to the behavior of RZs. This is consistent with the absence of 
RSB in CTs reported in some earlier studies [321 - F35] . 

The irrelevance of RZs to the 1RSB and FRSB has been considered in many aspects. 
By considering the boundary effect of CTs and BLs, we have concluded that the 1RSB 
cannot be observed by the current framework. On the other hand, the AT instability, the 
critical condition of the FRSB, has required some delicate discussions. We have inferred 
that the AT instability cannot be detected by the current formula without introducing the 
interaction among several replicas and the peculiarity of CTs and BLs is not essential. 
We have examined this statement by considering RZs of c = 3 RRG but any distinct 
conclusion could not be obtained because the system sizes are not sufficiently large, which 
is caused by the computational difficulty of the moment [Z n ] j of RRGs. Overcoming this 
difficulty needs some more idea and is left as a future work. Another possible way to 
examine the statement is considering the replicated systems with interactions among 
replicas. This strategy seems to be more hopeful but here we leave this problem as a 
future work too. 
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Chapter 5 

The replica symmetry breaking and 
the partition function zeros for 
Bethe lattice spin glasses 


In the previous chapter, we have investigated replica zeros of Cayley trees and discussed 
the possible links to the RSB. Our conclusion is that the replica zeros of Cayley trees and 
Bethe lattices cannot detect any RSB. According to some discussions about the boundary 
condition of Bethe lattices we have clarified that the peculiarity of Cayley trees and Bethe 
lattices makes it difficult to identify the 1RSB transition by the replica zeros. On the other 
hand, the FRSB has required more delicate discussions and we have finally inferred that 
the replica zeros are essentially not able to detect the FRSB, not due to the peculiarity of 
Cayley trees and Bethe lattices. To examine this conclusion, we investigate the partition 
function zeros of Bethe lattices with respect to the external field H and temperature T 
in this chapter. 

As mentioned in chapter 1, the spin-glass susceptibility is directly related to the non¬ 
linear susceptibility as eq. (11.51) . This fact implies that singularities with respect to the 
external field H well signal the AT condition, which is expected to be the same as the 
divergence of the spin-glass susceptibility. 

Utilizing the cavity method, we can accurately calculate the partition function zeros 
of Bethe lattices of infinite sizes. Our result implies that the FRSB is related to the 
continuous zeros of the partition function and can be detected in Bethe lattices despite 
the peculiarity, which supports our conclusion in the previous chapter. In addition, this 
result directly confirms a common belief that the AT instability leads to the continuous 
singular behavior of the system [ 83] . 

The results given in this chapter is in reference [El]- Note that most of numerical 
calculations in this chapter was done by Yoshiki Matsuda and he has the priority of 
those results. The zeros formulation given in section 15.2.11 was mainly investigated by 
Antoncllo Scardicchio and Markus Muller. The contributions of the author of this thesis 
to the results are mainly on investigating the formulation of the AT instability based on 
the divergence of the spin-glass susceptibility. Especially, the zero-temperature analysis of 
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the AT instability given in appendix 1C.II was performed exclusively by the present author. 


5.1 Phase boundaries and critical properties of Bethe 
lattice spin glasses 

Before proceeding to the formulation of the partition function zeros, we first review some 
critical properties of Bethe lattice spin glasses in this section. When the external held H 
is absent, the critical conditions of Bethe lattice spin glasses are given by 

(c - l)[tanh (@J)]j = 1, (5.1) 

(c — 1) [tanh 2 (/?</)] j = 1. (5.2) 

The first relation gives the boundary between the paramagnetic and ferromagnetic phases, 
and the latter corresponds to the transition from the paramagnetic to spin-glass phases. 

We here derive these relations by using the cavity method. Taking the n —)■ 0 limit in eq. 

(14.501) . we can find the equation of the cavity-held distribution (CFD) Pi(h) = lim n ^ 0 ^i(h) 
as 

/ c— 1 

nullah,)) 

3 =1 

If the external held H is absent, this equation always has the paramagnetic solution 
P(h) = 5(h) . Instability of this paramagnetic solution signals phase transitions to other 
phases. To perform the stability analysis, we expand the relation (14. 5 p with respect to h t 
and get 

c-i 

ht = ^Ujihj ~ -(1 - (5.4) 

3 =1 

where = tanh(/3 ,/,;.,)• Near the phase boundary, we can expect that the moments ( h n ) 
decrease rapidly as n grows, which validates to ignore higher order terms. Here, we treat 
up to the third order. Taking powers of eq. (15.4p and averaging with respect to P* which 
is denoted by the brackets (•••), we get 

(5.5) 

( h 2 ) = (c - l)t 2 (h 2 ) + (c — l)(c — 2)(2 p - 1 ) 2 t 2 (h) 2 , (5.6) 

< h 3 ) = (c - l)(2p - l)f 3 {<h 3 > + 3(c - 2) (h 2 ) ( h) + (c - 2)(c - 3)(2p - l) 2 ( h ) 3 } , (5.7) 

where we assume the ±J model 

P(Ji) = p5(Ji - J) + (1 - p)5(Ji + J ), (5.8) 


(h) = (c- 1)(2 p - 1) (^(h) - i(l - t 2 ) < h 3 > 


C— 1 

<5 | h- H -J2h j (J ij ,h j/ 

7—1 


(5.3) 
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and denote t = tanh(/3J). To investigate the stability of the paramagnetic solution 
(h) = (h 2 ) = (ft 3 ) = 0, we linearize eqs. fl5.5p ~ fl5.7p to yield 


/W\ / (c-l)(2 p-l)f 0 -|(c-l)(2p-l)«(l-t 2 ) \ ( (h) \ 

(h 2 ) = 0 (c-1 )t 2 0 ( h 2 ) . 

\{h 2 ) ) V 0 0 (c - l)(2p — l)t 3 J\(h 3 )J 

(5.9) 

This matrix has three eigenvalues ((c — 1)(2 p — 1 )t, (c — 1 )t 2 , (c — 1)(2 p — l)t 3 ). It is 
quite straightforward to rewrite these eigenvalues for general distribution P(J), and the 
explicit, form is ((c — l)[tanh(/3J)]j, (c — l)[tanh 2 (/3J)]j, (c — l)[tanh 3 (/3J)]j). When an 
eigenvalue exceeds unity, the paramagnetic solution becomes unstable, which yields the 
critical conditions (15.ip and (15.2p . In this chapter, we treat the ±J model with J = 1 on 
a c = 3 Bethe lattice, and here present the phase diagram in fig. 15.11 Symbols P, F, SG 



Figure 5.1: A T-p phase diagram of the ±J model without the external field on a c = 3 
Bethe lattice. Symbols P, F, SG in the figure represent the paramagnetic, ferromagnetic, 
and spin-glass phases, respectively. The dashed line is the AT line. The boundary between 
the ferromagnetic and spin-glass phases is not determined. The critical temperature 
between the paramagnetic and spin-glass phases is given by Tgc = 1/ tanh -1 [l/\/2] ~ 
1.13. The critical line T = T c {p) denotes the boundary between the paramagnetic and 
ferromagnetic phases. 


in fig. 15. II represent the paramagnetic, ferromagnetic, and spin-glass phases, respectively. 
The boundary between the ferromagnetic and spin-glass phases is not given in this figure 
because there is no known method to calculate this boundary. Although we did not 
discuss the AT condition so far, we provide the AT line as the dashed line in fig. 15.11 The 
detailed derivation of the AT line will be given in section 15.3.41 

From eqs. (I5.5p ~ fl5.7lh we can also obtain the critical exponents. Near the phase 
boundary between the paramagnetic and ferromagnetic phases, we can define a small 
parameter e by (c— l)[ta,nh / 9J]j — (c— 1)(2 p— l)t — 1 + e. For e < 0, the paramagnetic 
solution is stable but for e > 0 it becomes unstable and the ferromagnetic solution emerges. 


106 





















For the lowest order with respect to e, we find the ferromagnetic solution as follows; 


(h) = V3\ 


<*’> = ^ 


(c-1)(1 - (c-l)t 2 ) 1/2 

(5.10a) 

(c — 2){c — 3 — t 2 (c(c — 7) + 9)} C ’ 

(h 2 ) =- —— -—--e, (5.10b) 

x 7 c — 3 — f 2 (c(c — 7) + 9) ’ v 7 

(c-1)(1 - (c-l)f 2 ) 3/2 

(5.10c) 

(c-2){c-3-f 2 (c(c-7) + 9)} ' 


Equations (15. 10p indicate that the critical exponent (3, which yields the temperature 
dependence of spontaneous magnetization m (T — T C )P , equals to 1/2. Near the P-SG 
boundary, similar calculations are possible. In this case, we need the moments up to the 
fourth order. Assuming the absence of the ferromagnetic order (h 1 ) = ( h 3 ) = 0, we get 

(h 2 ) = (c - 1 )t 2 {(h 2 ) - jj(l - t 2 ) (/i 4 », (5.11a) 

(h 4 ) = (c — l)f 4 (h 4 ) + 3(c — l)(c — 2)t l (h 2 ) 2 . (5.11b) 


Putting (c — l)t 2 


1 + e, we find the solution of eqs. (15. 1 l[i in powers of e 


Y> 


c — 1 

2(c — 2) e + 



(c — l)(2t 2 — 3) 
2(c — 2)(1 — t 2 ) 
3(c-l) 


4(c — 2)(1 — t 2 ) 


+ 0(e 3 ), 

+ 0(e 3 ). 


(5.12a) 

(5.12b) 


This implies that the spin-glass order parameter q is proportional to e oc T — Tsc, which 
is known to be the same property as the SK model. 


5.2 Formulations 

Next, we present the formulation to yield the zeros of the partition function. The cavity 
method again plays a key role for this purpose. Antoncllo Scardicchio and Markus Muller 
mainly contributed to the derivation of the zeros formula given in section 15.2.11 Actual 
implementation of the formula was done by Yoshiki Matsuda and the author of this thesis. 

5.2.1 The partition function zeros of Bethe lattices 

Let us first consider the zeros of the partition function with respect to the uniform external 
held H, the Lee-Yang zeros [26]. The Lee-Yang zeros are known to be related to the 
magnetization of the system, and here we start from illustrating this point. In general, 
the partition function of an Ising system in the external held H is expressed as degree N 
polynomial with respect to e~ 2/3H as 

N N 

Z (H) = e NBH ft (k) e- 2k ? H = £e N ? H J] (e~ 2/3H - e ~ 2 ^), (5.13) 

k =0 i 
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where N is the system size and Q(k) is the partition function for a fixed magnetization 
M = N — 2k = Si- In the last equation, we factorize the polynomial and introduce 
the zeros e~ 2/3Hi . The leading factor £ is an irrelevant constant and hereafter omitted. 
Taking the logarithm of eq. (j5. 13j) and dividing by N, we get 

1 log Z(H) = -Pf (H) = PH + JJ d 2 H'g z (. H 1 ) log ( e~^ H - e" 2 ^'). (5.14) 

where g z (H) is the density of zeros on the complex H plane. The magnetization m (H) = 
—df/dH is then expressed as 

m (H) = 1 + JJ d 2 H'g~ ( H‘ ) (5.15) 

Taking an infinitesimal closed line integral with respect to complex P, we can derive 
g z {H) from the magnetization as 

gJH) = lim At / m(H')dH'. (5.16) 

2m r—>o nr 2 J\ l{ l{ , r 

This relation enables us to evaluate the density of zeros from the magnetization. 

Next let us turn to discuss the properties of Bethe lattices. We have defined a Bethe 
lattice as an interior part of an infinitely large Cayley tree. This means that a Bethe lattice 
is statistically uniform and the typical magnetization is represented by the magnetization 
of the central spin, which is expressed by using the CFD of the central spin, pO(h( c )), as 


m — d 2 h (c) P (c) (h (c) ) tanh (ph^). 


(5.17) 


Note that the domain of integration is two-dimensional (as d 2 /d c ') because we are now 
treating the complex cavity held. The central CFD phi (^(b) j s derived from the conver¬ 
gent CFD P(h) = lim^oo P 9 (h)0, where P g (h) denotes the CFD of the gth generation of 
a Cayley tree, as 


P (c) (h (c) ) 


5 /i (c) -H- E hj (Jij 7 hj ) n P (hj) d 2 hj 


3 =1 


3 =1 


(5.18) 


Substituting eq. (I5.17P to eq. (I5.16|h we obtain 


9z(H) = 


/? lim 1 


dH’ / d 2 /i (c) P (c) (h (c) ) tanh ( Ph {c) (iP)) 


2Tri r->0 rn 2 J\ H _ H ,\ =r 

lim -A / d 2 H' [ d 2 h (c) P (c) (h (c) ) V 5 (ph^ (H') 

^ovrr J\ H -H'\<r J „ eN V 

^ovrr J\ H _ H ,\< r neN 
^P (c) ((2n — 1) m/2P). 


2n - 1 


-m 


(5.19) 


neN 


1 The convergence of the CFD is shown rigorously in [32] for the real cavity-field case. Although 
this proof is not directly applicable to our case of complex cavity field, we numerically observed the 

convergence for p < 1 and hereafter assume it. 


108 













In the second line, we used the residue theorem under the condition that the radius r is 
sufficiently small. Equation (j5. 19j) enables us to calculate the density of zeros from the 
central CFD P^(h^). 

For a Bethe lattice, eq. (I5.19P can also be interpreted as follows. Remember that the 
partition function of the whole system of a Bethe lattice is given by 

Z = 2 cosh (/?h (c) ) f[ ( cosh 0 3J ij) z \ ( 5 . 20 ) 

7=i \ cosh {&%) ) 

This implies that the equation of zeros Z — 0 becomes identical tc@ 

Or) _ 1 

2 cosh (/3/iW) = 0 => ^h (c) = —^—7T®. (Vu e N). (5.21) 

Equations (15.191) and (15.21(1 provide a simple interpretation of the zeros of the Bethe 
lattice. That is the probability distribution that the partition function of a central spin 
becomes 0 is identical to the distribution of zeros of the whole Bethe lattice. This interpre¬ 
tation is useful for evaluating the density of zeros with respect to complex temperature. 
What we should do is to evaluate P^ c \h^) at the temperature T = 1/(3 fixed on a com¬ 
plex value and to calculate g z (/3) using the relation (15.191) . This prescription is one of the 
advantages by considering Bethe lattices and constitutes the main result of this chapter. 

5.2.2 Population method to evaluate the CFD 

In the previous subsection, we have derived the relation to obtain the distribution of zeros 
from the central CFD P^ c \h). The next step is to actually calculate the CFD. A widely- 
used numerical method for this purpose is the “population method”, the main idea of 
which is to represent the distribution by a population of N pop cavity fields hi. The actual 
procedure is as follows: 

1. Set the initial population of N pop cavity fields. 

2. Choose c — 1 fields randomly and compute a new field according to eqs. ((4.4(1 and 

flop. 

3. Replace a randomly chosen field with the new field. 

These procedures define a Markov chain on the space of the N pop fields. Usually, it is 
known that this chain has a stationary distribution and the stationary distribution satisfies 
the self-consistent equation of the convergent CFD P(h) in the limit N pop —> oo [30]. This 
population method is usually employed to evaluate the real CFD but we here apply this 
to the complex CFD case. 

2 Note that eq. (15.201) seems to diverge when the factor cosh (3hj becomes 0, but this is not the case. 
That is because the condition cosh/3 hj = 0 always involves Z 3 = 0 and the factor {cosh j3hj)~ 1 Z 3 yields 
a finite value. 
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We should here notice that there are two delicate points in applying the population 
method to complex P(h). 

One is related to the relevance of the boundary condition. Even in the real parameter 
case, the boundary condition is very important to correctly consider the spin-glass problem 
on Cayley trees and Bethe lattices, as discussed in the previous chapter. The selection of 
the boundary condition is directly related to the selection of the convergent CFD or the 
selection of the saddle-point of the corresponding regular random graph. Moreover for 
the complex parameter case, there is a possibility that other additional solutions of P(h) 
appear depending on the boundary condition. To avoid confusions coming from such a 
situation, we choose the boundary condition by referring to an “adiabatic” criterion, which 
is based on an intuition that the physically relevant complex P(h) should be smoothly 
continued to the real solution. This means that in principle the correct complex P(h) 
is derived by gradually increasing the imaginary part of the parameter during the cavity 
update. As one of the simplest choices according to this adiabatic criterion, we choose 
the fixed boundary condition, which yields the initial cavity bias as hi = J* where ./,; is 
the bond between the outermost site i and its ascendant. 

The other is the dimensionality of the zeros distribution g~. Hereafter let us focus 
on the ±J model, the bond distribution of which is given by eq. (15.81) . For the p = 1 
ferromagnetic case, the Lee-Yang zeros are distributed only in a one-dimensional subspace 
of the complex field plane, which is also the case for the zeros with respect to the complex 
temperature ptjlISS] . On the other hand, for several spin-glass systems the zeros are known 
to two-dimensionally spread in the complex plane [63ll6Tll86l - t9T] . These facts imply that 
the existence region of the zeros gradually spread as the ferromagnetic bias p decreases and 
the zeros distribution g z has its one and two-dimensional parts, g z i and g z2 , respectively, 
in a certain range of p. The problem is the one-dimensional part is difficult to detect 
by the population method because we use the two-dimensionally distributed population. 
For the Lee-Yang zeros case, however, we can expect that g z \ takes non-zero values only 
on the imaginary axis, which enables us to calculate g z i(H = i9) from the the following 

relatiorj^l ESI 


Re 


lim m(H = H r + id) ) = 2ng z \{9). 

H r —± 0 


(5.22) 


In general, if the region where g z \ takes non-zero values is exactly known, the evaluation 
of g z i is possible by using a similar relation to eq. (15.221) . Unfortunately, however, the 
exact location of such region of g z \ is not known in general situations. In the remainder 
of this thesis, we calculate g z ± only on the imaginary axis of the external held H = i6, 
and ignore other possible region of g zi . 


3 This relation is easily understood by regarding the relation (15.1411 between the free energy and the 
zeros distribution is the same as the one between the electrostatic potential and the charge distribution 
in a two-dimensional space. In this context, the magnetization corresponds to the electric field, which 
has the discontinuous jump on the line density of the charge. This analogy leads to eq. (15.221) . 
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5.2.3 Numerical procedures 

In the previous subsections we present the conceptual explanation of the procedures to 
obtain g z and the convergent CFD P(h). However, the implementation of those procedures 
is also involved and we here summarize actual numerical procedures. 

To this end, we first write down the update rule of the cavity bias hi , which is more 
numerically tractable than the cavity held, as 


hi = — tanh 1 

r* 


tanh (/3Ji) tanh (3 



(5.23) 


where J* is the bond between the site i and its ascendant. We hereafter assume that the 
function tanh -1 takes the principal branch, which restricts the value of the imaginary 
part of the bias to a range [—vr//3,7r//?]. The cavity bias distribution (CBD) for the gth 
generation P g {h) is represented by a population and is updated by eq. (I5.23|) until P g (h) 
converges. 

After the convergence, the central CFD ph)(^(c)) j s calculated from the convergent 
CBD P(h) = linig^oo Pg(h) as 


P (c)( /l ( c )) = I f[ ^hjPfyS ( h (c) -H-J^h 

J j =1 V 3=1 


(5.24) 


and g z is calculated from pF)(/d c )) by us ing eqs. (I5.19p and (I5.22p . 

Before closing this subsection, we summarize the actual steps of the algorithm: 

'i ^Vpot -~ 

1. Generate the initial population < hi > as hi = Jj = ±1 according to the distribu¬ 
tion (15.8p . 

2. Update the population by the relation (I5.23p until P g (h ) converges. 

3. Calculate the central CFD P^ c \h^) by eq. (I5.24p . 

4. Estimate the two-dimensional part of the zeros density g z 2 by 

g z2 (H,T) = J2 pic) ( h(c) = ( 2n-l)m), (5.25) 

nGN 

for a given H and T. 

(a) When the external field is pure imaginary H = i6, estimate g z i{H = id,T ) 
separately by 

g zl (H = iO,T) = -^R e{m{H = i9)) 

Ztt 

= — Re ( Jim j d 2 h^P^ ( h tanh 


(5.26) 


H=iO+H R 
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Iii the remainder of this thesis, we assume the conditions c = 3 and N pop = 10 6 . We 
performed at least 5000iV pop cavity iterations until the population converged. After the 
convergence, we took the average of the objective quantities (g z 2 and m(H = id )) over 
additional 5000A^ pop steps to avoid possible fluctuation due to the finiteness of the popu¬ 
lation. 


5.3 Result 

In this section, using the formula given above, we derive the distributions of the zeros of the 
presented model for several values of temperature T, external field iL, and ferromagnetic 
bias p. The physical significance of the zeros distribution is discussed and the phase 
diagram of this model is re-derived in terms of the zeros. The relevance of the zeros 
distribution to the AT instability is also argued, which leads to a conclusion that the AT 
instability corresponds to the continuous distribution of zeros on the real axes of T and 
H. 


5.3.1 Zeros on the complex field plane 


First, we show the density of zeros on the complex field plane, the Lee-Yang zeros, for fixed 
real temperatures. For simplicity of calculations, we rescale the complex field H as 2/3 H 



Figure 5.2: Distribution of zeros on the complex 2 (3H plane with p = 0.5 at T = 1.43 
(left) and 0.5 (right). Densities are colored in logarithmic scale. Zeros with finite real 
part approach the real axis at low temperature, whereas g z \ is numerically zero. 


the complex 2/3H plane with p = 0.5 and T = 1.43 > T sg = 1/tanh 1 (l/\/c - l) (left) 
and 0.5 < Tsg (right). To draw this figure, we changed the value of Re(2 j3H) from 0 to 
12 with the increment 0.25 and of Im (2 (3H) from 0.02 to 7 t/ 2 with the increment of 0.02. 
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Each evaluated point locates at the center of each cell in fig. 15.21 and the corresponding 
value of g z represents the value of the cell. The density out of the range is omitted, since 
the range is sufficient to see zeros near the real axis which are relevant to the critical 
phenomena. Both g 2l and g Z 2 are plotted in the same figure and colored in logarithmic 
scale; the black dots show a very high density. 

The left panel of fig. 15.21 (T = 1.43) is for the paramagnetic phase. In both g z \ and 
g z2 parts, the zeros do not reach the real axis, which means there is no phase transition. 
On the other hand, the right panel of fig. 15.21 is in the spin-glass phase (T = 0.5) and 
the zeros reach the real axis at a certain value 0 < Hsg £ M. This means that there is 
a phase transition at R e(H) = Hsg hi the Bethe lattice. Besides, below the critical held 
Hsg, zeros continuously touch the real axis, which indicates that the phase transitions 
continuously occur in the range of |Re(if)| < Hsg■ This behavior is quite different from 
usual phase transitions, and seems to be related to the chaos effect of a small change of 
held. The chaos effect is considered to be the result of the instability of randomly frozen 
spin configurations in the spin-glass phase and to be one of the characteristic properties 
of spin glasses. Note that the one-dimensional density g z \(H = i6) is numerically zero 
at all the range of 6 in this p = 1/2 case, which implies the absence of singularities of 
the magnetization. This fact suggests that the Griffiths singularity [92], which is the 
essential singularity of the free energy with respect to the external held H at H = 0 and 
is considered to appear in some diluted ferromagnets and spin glasses, is absent in the 
current Bethe lattice spin glass without the ferromagnetic bias (p = 1/2). 

As the ferromagnetic bias p increases, the ferromagnetic phase appears and the sit¬ 
uation changes. Figure 15.31 is of the case p = 0.9. The right panel of fig. 15.31 is in the 



Figure 5.3: Distribution of zeros on the complex 2(3H plane with p = 0.9 at T = 1.5 (left: 
para) and 0.5 (right: ferro). Only the one-dimensional part of the zeros on the imaginary 
axis (thin lines) approaches the origin at the low temperature. 

ferromagnetic phase, in which g z2 does not reach the real axis but only g z i touches the 
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origin. Besides, comparing to the left panel of fig. 15.21 we can find that g z \ has a finite 
value on the imaginary axis away from the origin. These observations indicate that the 
ferromagnetic ordering is characterized by g z i, while g z 2 signals the spin-glass ordering. 
According to this distinction of roles of g z 1 and g z2 , we can draw the phase diagram of 
the current system and will present the result in section 15.3.31 


5.3.2 Zeros on the complex temperature plane 


Assuming the temperature is complex, we can also obtain the density of zeros on the 
complex temperature plane at a fixed H € C. 

Figure 15.41 shows the zeros on the temperature plane at p — 0.5 with H = 0 (left) 
and H = 0.5 (right). All the (two-dimensional) zeros below the spin-glass transition 



Figure 5.4: Distribution of zeros on the complex T plane with p = 0.5 and H = 0 (left) 
and H = 0.5 (right). Zeros reach the real axis below the critical temperature T$g — 1-13 
(left) and 0.5 (right). The apparent absence of zeros near the origin may be due to 
numerical rounding errors of tanh j3. 


temperature T$g — 1-13 also reach the real temperature axis. This result reconfirms 
that the spin-glass transition differs from usual phase transitions where zeros touch the 
real axis only at the transition temperature. The continuous singularities in the range 
of Re(T) < Tsg again implies the chaos effect against temperature deviation. The right 
panel of fig. 15.41 shows that the spin-glass phase is stable under a weak held (H = 0.5), 
which is in accordance with the Lee-Yang zeros result (the right panel of fig. 15.2|h 

The distributions at high p are also interesting. Figure [53] shows the density at p = 0.9 
with 2 j3H = 0 (left) and 2/3 H = 10(right). The critical temperature between the 
paramagnetic and ferromagnetic phases is known as T c ~ 1.36 at p = 0.9. We can find that 
the zeros protrude and tend to distribute in a sharp curve near this critical temperature 
T c , which implies the existence of the one-dimensional part of the zeros density near T c . As 
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0 0.29 r c =1.36 0 0.29 r c =1.36 

Figure 5.5: Distribution of zeros on the complex T plane with p = 0.9 and 2 /3H = 0 
(left) and 2/3 H = 10“ 4 i (right). The zeros tend to approach the real axis near T = T c , 
where T c ~ 1.36 is the ferromagnetic critical temperature. It can be also observed that 
zeros reach the real axis at and below another lower critical temperature. This second 
critical temperature corresponds to the AT line as shown in fig. 15.61 The one-dimensional 
part of the zeros is revealed by introducing a small imaginary held and lies on the real 
axis in the right panel. 


mentioned in section 15.2.21 however, we cannot directly detect this one-dimensional part 
by the current formalism using the two-dimensionally distributed population. Instead, 
we introduce a small pure imaginary held 2 f3H = 10” 4 z and investigate g z i, the result 
of which is in the right panel of hg. 15.51 This figure clearly shows the presence of a 
critical temperature near Re(T) ~ 1.36; zeros have finite densities on the real axis below 
Re(T) ~ 1.36, which rehects that g z \(H = i6,T) is finite for 9 ~ 0 in the ferromagnetic 
phase. On the other hand, the two-dimensional part of the zeros distribution, g z2 , also 
touch the real axis at and below Re(T) ~ 0.29. This situation is the same as hg. 15.41 
and indicates that the system is in the spin-glass phase in this region. As shown in later, 
this critical temperature quantitatively accords with the AT line, which we identify with 
the divergence point of the spin-glass susceptibility as the chapter 4. This fact strongly 
supports our speculation that the two-dimensional part of the zeros distribution, g z2 , 
dominates the spin-glass behavior of the system. 

5.3.3 Phase diagram 

The previous observations lead to an ansatz that two types of transitions are classified 
by one- and two-dimensional parts of the zeros distribution; the one-dimensional part g z \ 
detects the ferromagnetic phase transition and the two-dimensional part g z2 signals the 
emergence of the spin-glass ordering. According to this ansatz, we can plot the p-T phase 


115 













diagram and the result is given in fig. 15.61 Note that the T-H phase diagram is also drawn 



Figure 5.6: Phase diagrams on the p-T plane written by the density of zeros. The 
solid lines are analytically given as T c = l/tanh -1 [l/ (4p — 2)] (para and ferro) and 
Tsg = 1/tanh -1 [l/\/2] (para and spin glass). Left: Circles and triangles are determined 
by two-dimensional density of zeros g z2 on the complex field and temperature planes, 
respectively, which corresponds to the AT line as shown in section 15.3.41 Squares are phase 
boundaries calculated by one-dimensional density of zeros g z 1 indicating the ferromagnetic 
order. Note that our result does not immediately conclude the phase boundary between 
mixed and spin-glass phases. Right: Blow up of the critical temperatures derived from 
g z 2 on the left panel. 

by the same procedure. That diagram has also some interesting features but we here omit 
it because the p-T phase diagram is sufficient for the current purpose of examining the 
AT instability of the Bethe lattice spin glass. 

The resulting phase boundaries in fig. 15.61 well agree with the analytical ones, T c = 
1/ tanh -1 [1/ (4 p — 2)] (para and ferro) and Tsg = 1/ tanh -1 [l/\/2] (para and spin glass). 
This fact supports our ansatz that g z \ and g z2 correspond to the ferromagnetic and spin- 
glass ordering, respectively. To examine the relation between g z2 and the AT instability 
further, in the next subsection we investigate the relation between the boundary obtained 
from g z2 in fig. 15. 6 1 and the AT line, which we identify with the divergence of the spin-glass 
susceptibility. 


5.3.4 The divergence of the spin-glass susceptibility 

Let us remember the discussions in section 14.4.31 and develop a similar argument in the 
limit n —> 0. The spin-glass susceptibility is then given by 


1 

XSG ~ 




(5.27) 
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Considering the fact that on a Bethe lattice an arbitrary pair of sites is connected by 
a single path and using the chain rule of the derivative operation, we can rewrite this 
quantity as 


Xsg 


0=1 



(5.28) 


where the factor c(c — 1) G denotes the number of sites of distance G from the central site 
0. This yields the divergence condition of xsg as 


log(c — 1) + lim — log 

G-loo G 



dhg -1 

dh„ 


= 0 . 


(5.29) 


J j/ 


In order to estimate the divergence points of the spin-glass susceptibility at finite 
temperatures, we numerically implement the calculation of the factor 


G 


n 




(5.30) 


A naive consideration that the derivative can be estimated by the difference coming from 
a small deviation yields 


<9/) 0 h 0 (he + A ha) — h 0 (jxjj 
dh G A h G 


(5.31) 


The procedure to evaluate this equation is as follows. We arrange two replicas of an iden¬ 
tical population {hi}^ p expressing the convergent CBD P(h). In addition, we introduce 
a uniform perturbation (A he = 10 -4 ) into only one of two replicas, and then observe the 
square average of the variation (l/A^ pop ) (hi(hc + A he) — hi(hc)) 2 after a certain 

number of the cavity updates. 

In particular, we update two populations by 500(W pop iterations with the same set of 
Jij. A critical line of the divergence of the spin-glass susceptibility is determined whether 
the square average is numerically zero or much larger than the original perturbation. The 
result is shown in fig. 15.71 where the spin-glass susceptibility diverges below this line. This 
result well agrees with the phase boundary drawn by g z2 in fig. 15.61 which implies that 
the continuous distribution of g z 2 on the real axis corresponds to the divergence of the 
spin-glass susceptibility. Combining the behavior of g z2 and the discussions about the 
divergence of the spin-glass susceptibility in section 12.6.11 we can expect that the current 
results reveal a physical aspect of the AT instability or the FRSB. Namely, the FRSB is 
related to the continuous singularities of the partition function, which is the common belief 
about the AT instability as mentioned in the beginning of this chapter. Consequently, 
we can reasonably conclude that the presented results leads to the AT instability of the 
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Figure 5.7: The divergence points of spin- 
glass susceptibility, which is denoted by the 
inverted triangles. The circles represent 
the phase boundary estimated by the two- 
dimensional distribution of zeros (fig. 15.61) . 
They agree well each other. The criti¬ 
cal value of the ferromagnetic bias psg = 
0.92067 at zero temperature is indicated by 
the colored circle. 


Bethe lattice spin glass as the continuous singularities of the partition function and meets 
the purpose of this chapter. 

Note that at zero temperature, evaluating the condition (I5.29j) can be performed in 
a more analytical manner. The result gives the critical value of the ferromagnetic bias 
Psg — 0.92067 which well agrees the estimated value by the finite-temperature results 
derived by both the zeros and spin-glass susceptibility analyses. The details of the zero 
temperature analysis are rather involved and presented in appendix 1C. 11 

5.4 Summary 

In this chapter, we founded the formulation to investigate the partition function zeros of 
Bethe lattices by utilizing the cavity method, for the purpose of investigating the AT in¬ 
stability of the Bethe lattice spin glasses. In the formulation, the cavity field distribution, 
which can be evaluated by using the population method, is directly linked to the density 
of zeros. This enables us to assess the zeros density in infinite-size Bethe lattices by using 
the cavity method. 

Using this formulation, we investigated the ± J model on the coordination c = 3 Bethe 
lattice. The density of zeros consisted of two parts: One-dimensional and two-dimensional 
densities. We found that the two-dimensional density is related to the spin-glass ordering, 
while the one-dimensional part on the imaginary axis of the external field corresponds to 
the ferromagnetic transition. These observations were confirmed by comparison with the 
conventional critical conditions. The resultant p-T phase diagram was drawn by those 
two different ways, and the accordance between them is excellent. 

Our result about the zeros indicates that the system is singular everywhere in the 
spin-glass phase. This observation and the relation between the AT instability and the 
divergence of the spin-glass susceptibility enable us to reasonably conclude that the con¬ 
tinuous singularities reveals a physical aspect of the AT instability and the FRSB phase 
is present in the Bethe lattice spin glass, which meets the purpose of this chapter. 

Throughout this thesis, we consider the 1RSB and FRSB transitions separately. A 
possible further work is to clarify the behavior of zeros of the systems with the 1RSB. 
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In the random energy model, it is known that the zeros touch the real axis at only the 
transition point jHHEI], which is in contrast to our result of the FRSB case. The current 
formalism can treat any RSB in the same framework and can be expected to give useful 
information about other types of the RSB. Investigation along this line is quite hopeful 
and is currently under way. 


119 


Chapter 6 
Conclusion 


In this thesis, the replica method was reviewed and examined from several viewpoints. 
The replica symmetry breaking (RSB) was the central concept about this issue and was 
investigated by several ways. The generating function of the partition function Z, 4>(n) = 
(1 /N) log[Z n ] appearing in the replica method, played a key role in the investigation. 

In chapter 2, we presented a review of the replica method in a form including recent 
descriptions of the method. The important concepts for this purpose are the probability 
distribution of the free energy and the pure states which are disjointed sets of configura¬ 
tions in the phase space. Two characteristic exponents, the complexity characterizing the 
number of pure states and the rate function characterizing a small probability of the free 
energy, are naturally embedded in the replica procedures. Practical calculations of those 
quantities were demonstrated on the fully-connected p-spin interacting model for several 
values of p. Especially, since the limit p —* oo makes the calculations easier, many aspects 
of the RSB in the one-step level (1RSB) were elucidated in this limit. As a result, we 
found that the transition to the 1RSB phase occurs due to the crisis of the complexity. 
This consequence was re-derived from the large deviations of the free energy, and it was 
revealed that the 1RSB is also signaled by the rate function of the probability distribution 
of the free energy. We also pointed out that the behavior of the rate function is closely 
related to the analytical properties of the generating function 0(n) and can be understood 
by some necessary conditions which should be satisfied by the correct </>(n). 

On the other hand, another RSB, the full-step RSB (FRSB), is characterized by the 
de Almeida-Thouless (AT) condition which is the local stability condition of the replica 
symmetric (RS) saddle-point. We demonstrated this point for p = 2 and 3 cases. The 
relation between the AT instability and the divergence of the spin-glass susceptibility was 
also discussed. In addition, for p = 3, we pointed out that the dynamical 1RSB transition 
exists, which cannot be observed by the RS ansatz and require the 1RSB prescription 
with the complexity analysis. As a consequence of the above considerations, the phase 
diagrams for p = 2, 3 and oo on the T-/3n plane were presented. 

Besides, in the end of chapter 2, the microscopic description of the pure states were 
presented. To this end, the formulation by Thouless, Anderson and Palmer (TAP) was 
discussed and the equivalence with the replica result was shown; the characteristic ex- 
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ponent of the number of solutions of the TAP equation becomes identical to that of the 
complexity. We also showed that the solution of the TAP equation at zero temperature 
can be identified with the spin configurations stable against any single spin flip, which 
provides a simple interpretation of the pure state and is useful for identifying the pure 
states by numerical methods. 

In chapter 3, we analyzed the Ising perceptron, which is a model of a neuron, by the 
replica method. To study the structure of the synaptic weight space, we intensively used 
the concept of the pure states and calculated the complexity in the 1RSB level. The com¬ 
plexity analysis revealed that the weight space consists of many clusters (pure states) for 
a < a s = 0.833... where a = M/N is the ratio of the number of the embedded patterns M 
to the system size N. Besides, it was shown that the weight space is equally dominated 
by a single large cluster of exponentially many weights and exponentially many small 
clusters of a single weight. This fact means that any information about the middle-size 
clusters cannot be obtained in the replica method due to the convex downward form of the 
cluster-size distribution. On the other hand, for a > a s , we calculated the rate function to 
evaluate the small probability that a given set of random patterns is atypically separable 
by the Ising perceptron. The result showed that for a s < a < acn = 1.245... the rate 
function takes the minimum for n s > 0 and the system freezes out below n s , which is a 
new type of frozen RSB phases and is not directly related the conventional 1RSB ones. 
For n > Ugd, it was shown that the analyticity of the rate function drastically changes, 
which implies that the dominant configuration of the atypically separable patterns ex¬ 
hibits a phase transition at this critical ratio. Extensive numerical experiments were also 
conducted and supported the above theoretical predictions. 

In chapter 4, zeros of the nth moment of the partition function [ Z n } were investigated to 
directly reveal the analyticity breaking of </>(n) in a vanishing temperature limit f3 —>■ oo, 
n — )■ 0 keeping y = /3n ~ 0 ( 1 ) by combining the replica and cavity methods. In this 
limit, the moment parameterized by y characterizes the distribution of the ground-state 
energy. We numerically investigated the zeros for ±J Ising spin glass models defined 
on several Cayley trees and ladders. For several Cayley trees, we found that the zeros 
tend to approach the real axis of y in the thermodynamic limit, which implies that the 
moment cannot be described by a single analytic function of y as the system size tends 
to infinity. To explore the possible links of those analyticity breaking to the RSB, we 
examined the analytical properties of 0(n) and assessed the spin-glass susceptibility which 
can be identified with the AT instability. To this end we employed two relatives of Cayley 
trees, Bethe lattices and regular random graphs. The result revealed that the analyticity 
breaking indicated by the zeros of Cayley trees is relevant to neither the 1RSB and FRSB. 
We concluded that the peculiarity of Cayley trees and Bethe lattices makes the 1RSB not 
appear in those systems. On the other hand, the FRSB required some delicate discussions. 
According to the analysis of the modified generating function introduced interactions 
between replicas, we finally inferred that the AT instability cannot be detected by the 
current formula. 

In chapter 5, to remove a possibility that the FRSB does not occur on Cayley trees 
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and Bethe lattices considered in chapter 4, we investigated the zeros of the partition func¬ 
tion of the ± J model with respect to the external field H and temperature T on a Bethe 
lattice with the coordination number c = 3, by utilizing the cavity method. The result 
indicates that once the spin-glass phase emerges, the two-dimensional part of the zeros 
continuously tough the real axis, which means that the system is singular everywhere in 
the spin-glass phase. Combining this observation and the relation between the AT in¬ 
stability and the divergence of the spin-glass susceptibility, we could reasonably conclude 
that the continuous singularities of the partition function reveals a physical aspect of the 
AT instability and the FRSB phase is present in the Bethe lattice spin glass. 

Main results of this thesis are summarized as follows: 

1. Clarifying the behavior of the generating function when the complexity and rate 
function are not convex upward (chapter 3). 

2. Comparing the analytical value of the rate function with the numerical one quali¬ 
tatively and supporting the validity of the replica method (chapter 3). 

3. Proposing a new method to investigate zeros of the moment [Z n ] with respect to 
the replica number n and finding the analyticity breaking of 4>(n) by using the zeros 
(chapter 4). 

4. Clarifying the relation among Cayley trees, Bethe lattices, and regular random 
graphs in the context of the RSB (chapter 4). 

5. Drawing a phase diagram of a Bethe lattice spin glass in terms of the partition func¬ 
tion zeros and reasonably identifying the FRSB phase by the continuous singularities 
of the free energy (chapter 5). 

Although the spin-glass theory has its long history, the essential comprehension of 
physics of spin glasses is still lacking. One of the main controversial points in the theory 
is whether the mean-field description is applicable to finite-dimensional systems or not. 
To obtain the solution to this problem, much effort have been made not only on directly 
studying finite-dimensional systems but also on improving the mean-field theory itself. 
The presented researches in this thesis can be regarded as one of such improvements in 
that our results provide some new aspects of the replica method being one of the central 
methods of the mean-field theory of spin glasses. 

Besides, our results suggest further possibilities. Deeper understanding about pure 
states can provide some insights on several other problems, e.g. structural glasses, op¬ 
timization problems and so on. The zeros formulations given in chapter 4 and 5 are in 
principle applicable to finite-dimensional systems, which can lead to further comprehen¬ 
sion of finite-dimensional spin glasses. Also, our results of the Lee-Yang zeros in chapter 
5 can provide a possibility of detecting the RSB in real experiments by observing the 
response of the system to the external field, like the Griffiths singularities p3] . 
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In the light of the above possibilities, we have several hopeful future works. 

Lessons from chapter 3 tell us that in other research fields there probably exist many 
other systems exhibiting extraordinary behavior of the generating function, complexity 
and rate function. This implies that investigation of such systems can reveal not only 
the properties of the systems but also the remaining mysteries of the replica theory. 
Researches along this line are already one of the rapidly-expanding mainstreams of the 
current spin-glass theory and will continue to develop at least for the near future. 

The replica-zeros formulation in chapter 4 should be improved to be a more tractable 
form. In the current formulation, the replica zeros require huge computational time 
which prevents us from treating systems of large sizes. Moreover, we should clarify the 
relation between the replica zeros and the AT instability to investigate whether the AT 
instability occurs in finite-dimensional systems or not. The formulation of the inter¬ 
replicas interactions may be useful for this purpose and should be developed in the future. 

The Lee-Yang zeros in chapter 5 may be most hopeful in clarifying the properties of 
real spin glasses, since they are directly related to the external field being controllable 
in real experiments. To give concise predictions for real experiments, we should obtain 
more detailed information about the distribution of the Lee-Yang zeros. The precise 
functional form of the distribution may enable to distinguish the RSB response from the 
normal one in the scaling form of the magnetization with respect to the external field. 
Obviously, we should find out the behavior of the zeros distribution in different types of 
RSB. Investigation of this point is a promising research and is currently underway. 

It would be expected that the future direction of the spin-glass theory is classified 
broadly into two lines. One is the mathematical foundation of the mean-field theory in a 
more rigorous way. The other is the application of the spin-glass theory to a wide variety 
of different systems; real spin glasses, structural glasses, information processing tasks, 
and so on. The results presented in this thesis probably contribute to both of the two 
directions. This is because the mathematical structure of the replica method is closely 
related to both of the mathematics and physics of spin glasses. We hope that the reviews 
and results in this thesis become a basis to researches in such directions and inspire further 
study and understanding of spin glasses and beyond. 
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Appendix A 

Calculations for chapter 3 


A.l Derivation of the RS saddle-point equations and 
the limit q —> 1. 


Differentiation of eq. (13.18[) with respect to q yields 

del) 1 J Dz lk E l3 

= --n[n — 1 )q + a- 


d( i 2 " /' DzE 

The following integration requires some algebras 
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The differentiation of Ep with respect to q gives 
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Inserting this expression into eq. 11A.2[) and integrating by parts with respect to z give 
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(A.4) 


Substituting this equation into eq. (I A. 1 j) and reducing some factors, we finally get the 
saddle-point equation (13.21(1 . The other saddle-point equation (13.201) is also derived in a 
similar way. 

Next we take the limit q —> 1 in eqs. (13.20113.2T]) . In this limit, the argument of E, 
zyjqj 1 — q, diverges to oo or — oo depending on the sign of z and we need the asymptotic 
behavior of E(x) 


E(x) —* 
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(A.5) 
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which leads to Ep(x) —> e 13 for x —> oo and 1 for x —* — oo. Hence, we can calculate the 
asymptotic behavior of q as 
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This condition q —> oo enables us to calculate the following integration 
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(A.7) 


Substituting these results into eq. (j3.18jl . we obtain the RS2 solution (I3.44p . 


A.2 Derivation of the AT condition 


We consider small deviations of eq. (13. lip around the RS saddle points. We use the nota¬ 
tion q^ = q + y fJ ' u , q ,,;U = q + y ,JV and expand eq. (13.111) with respect to the perturbations 
y^ and y^ iv . The terms of first order of y^ and y IJV becomes automatically 0 because we 
impose the saddle-point conditions with respect to q and q. Hence, the relevant terms in 
the first term of eq. (13.111) become 


H<v n<v 

Similarly, for the second term of eq. (13.111) . 
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where the brackets ((•••)) denote the following average 
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To expand the third term of eq. (13.111) . we need some more algebras. First, we write down 
the general form of the probability distribution of [f(u)] u 


[/(«)]» = 



(A.ll) 
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where | u) expresses the u vector whose /ith component is and Q is the matrix whose 
elements are spin-glass order parameters 


Qr = <r ■ 


(A.12) 


This distribution satisfies relations (13.81) . We here employ the following identity 


g-jWQ V) _ 


det Q 
(2?r)^ 


\dv» 

VM=1 




(A. 13) 


Using these formulas, we get 


log[/(u)]« = log^p 


\duW ] 

VM=1 / 


= log 




( Kv v v s v u ] v - kdi.wj , 

5<oj 

where the brackets [(• • • )]„ denote the following average 

/ (n;=i du^dv^j (• • • ) e -!HQRsh>-iH«>/( w ) 
/ fn ? t=i du^dv^] e^^UlQRs 


(A.14) 


(A.15) 


This average with respect to u can be transformed to the average with respect to w by 
using the integral by parts 


J du ll dv^ 


(«IQRsh)-i(u|u) 


2 


/(«) 


i/(aH 


3 -|<«IQrsI«>-*H“> 


df(u) 
duv 


(A.16) 


Hence, we get 


Y.Y.y^y 5 " - K^]>vy 

H<v 5<u 


EE 

fl<V 6<UJ 


y^y 


&, [d^f]u [d^f]u [dswf]* 


[/], 


[/]« [/]•< 


(A.17) 


where the symbol d x ^i... x ^i means 


<9 


i -L -L dx ™ 1 

i =1 4 


n 


(A.18) 
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and note that [(• • • )] u is the same average as defined in Sec. 13.21 Summarizing above 
results, we can derive the explicit form of the Hessian G around the RS ansatz 



3y 


[IV 


+ r u y Su 


((s p s v s 5 s“) - (S^S") (S s S“)) 


+ay^y 5 “ 


([d^SufU 

V [f)u 


[d^f} u [^/]{^ } \\ 

[f]u [f}u ) j 


(A.19) 


Here we classify the elements of G by using the following notations 


P = a ([<9^2/]„/[/]„ - (\d^f] u /[f} u ) 2 ) , 

(A.20) 

Q = « {[d^sf]u/[f\u ~ [d^f]u[d^f]u/[f]l ), 

(A.21) 

R = ot {[d^6uf]u/[f]u - [d^f} u [d Su f}u/\f} 2 u ), 

(A.22) 

P = 1 - (S p S u ) 2 = 1 -q 2 : 

(A.23) 

Q = (S tt S v ) - (S p S v ) (S p S 5 ) =q~q 2 , 

(A.24) 

R = (S P S’ J S 5 S U1 ) - (S P S U ) = r — q 2 , 

(A.25) 


where r 


(S^S u S 5 S u y Using these notations, we can express the Hessian G as 


/ P Q---Q R---R 

Q---Q R -R P 

\ 

/ 


P Q ■■■(.) R -R 

I 


V 

Q---Q R -R P / 


(A.26) 


where I is the unit matrix of rank n{n — l)/2. 

Let us find the eigenvectors of this matrix by a heuristic approach found by de Almeida 
and Thouless. The first eigenvector sx is obtained by assuming y pi/ = a and y pv = a for 
any y, u . The upper half of the eigenvalue equation Gs i = AiSi gives 


^P + 2 {n — 2 )Q + -{n — 2)(n — 3)R^j a + a = Aia, (A.27) 

and the lower half yields 

a + (p + 2 (n — 2 )Q + —{n — 2 ){n — 3)R J a = A\a. (A.28) 


These equations have the eigenvalue Ai with non-vanishing a, a, which must satisfies the 
following relation 

A\ - (Ad + X 1 )X 1 + (A,A, - 1) = 0, (A.29) 

where Ai = P + 2(n — 2)Q + (n — 2)(n — 3)R/2 and X\ = P-\-2{n — 2)Q + {n — 2){n — 3)R/2. 
This equation says that this mode constructs a two-dimensional space. 
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The next type of solution s 2 is obtained by treating a replica 9 as a special one. We 
assume 9 = 1 without loss of generality. This solution s 2 has y^ v = b and y 1 ' 1 ' = b when y 
or v is equal to 1, y = c and y pu = c otherwise. The first low of the eigenvalue equation 
Gs 2 = X 2 s 2 gives 

(P + (n — 2)Q)b + ^(n — 2)Q-(n — 2 ){n — 3 )R^j c + b = A 2 b, (A.30) 

and the first low of the lower half yields 

b + ^P + (n — 2)Q) b + ^(n — 2 )Q + -{n — 2){n — 3 )R^j c = A 2 b. (A.31) 

We here use the orthogonal condition of the solutions s 2 and s±. We expect that the 

upper half of s 2 is orthogonal with that of independent of the lower half space. This 
leads to 

(n — 1)6 + i(n — l)(n — 2)c = 0, (A.32) 

and the same relation holds for b and c. Substituting these conditions, we get 

(P + (n - 4)Q - (n - 3)R) b + b = A 2 b, (A.33) 

(P + (n - 4)Q - (n - 3)p) b + b = X 2 b, (A.34) 

and with non-vanishing b and b, this leads to 

\l - (X 2 + X 2 )X 2 + (X 2 X 2 - 1) = 0, (A.35) 

where X 2 = P + (n — A)Q — (n — 3 )R and X 2 = P + (n — 4 )Q — (n — 3 )R. There are n 
possible choices of the special replica 6 and there are two eigenvalues for the solutions S! 
and s 2 , which means that Si and s 2 construct 2n-dimensional space. 

The third mode s 3 is obtained by treating two replicas 9, oo as special ones. This 
solution s 3 has y 9u = d and y° u = d, y 9tl = e and y Wfl = e, and y^ = f and y^ v = / 
otherwise. Following the similar argument to the case of s 2 , we obtain 

A 3 - (X 3 + X 3 )X 3 + (X 3 X 3 - 1) = 0, (A.36) 

where X 3 = P — 2Q + R and X 2 = P — 2Q + R. This solution constructs n{n — 3)- 
dimensional space and all the eigenvalues are exhausted by these three modes. 

For the stability of the saddle point, all of the eigenvalues must be non-negative. This 
condition corresponds to 

Vi, XiXi < 1. (A.37) 

Note that the desired condition is X i X l < 1 but not X,X l > 1. That is because q^ iu is 
originally pure imaginary variable, which means that 5q^ ,v 5q u ‘ u is associated with a factor 
i and 5q fiu 5q p ‘ 1 ' is with a factor —1. Hence, if we change the variable from q p,v to the 
diagonal block of lower half of G yields a factor —1 and the off-diagonal part becomes il, 
which leads to the positivity condition of the eigenvalues as eq. (1A.37I) . 
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The most relevant mode is s 3 and to check this condition we next calculate eqs. 
flA.20HA.25j) . The order parameter q is already given by eq. (13.201) and the quantity 
(S fl S u S ul S s ) = r is calculated in a similar way to the derivation of eq. (I3.20j) . The result 


is 


r = 


f Dz cosli" \[fiz tanh 4 
cosh” y/qz 


(A.38) 


The factor P — 2 Q + R requires to assess [dgf] u . This factor is calculated as 



where we used the explicit form of the function f{u ) = exp(—/3 Y^=\ d(u^)) and denoted 
E'g(x) = dEp(x)/dx. All the derivatives in the factor P — 2 Q + R can be similarly 
calculated. The result is 


P-2Q + R 


a 


f DzE- 




(1 -q ) 2 JDzE1 


2 


(A.40) 


where we omit the argument \/q/( 1 — q)z of the functions Ep, Eg and E'L and the explicit 
forms of Eg and Eg are 


E'g{ X ) = 


1 - e -/3 


e~* x , E'Rx) = 


_ d 2 Ep(x) _ 1 - e~P _i 


dx 2 




xe 2 


(A.41) 


Finally we obtain the AT condition as 


A3A3 = 


a 


E'L 


IdzeU-^-U 


■I \ 2 


’p) ) J Dz cosh ” -4 \fqz 


(!-9) s 


/ DzE 


J Dz cosh” \ffiz 


< 1 . 


(A.42) 


A.2.1 AT instability of the RS2 solution 

The AT condition for the RS2 saddle point is calculated by taking the limits q —> 1 and 
q —> 00 . In the limit (3 —» 00 , the function Eg(x) is reduced to the complementary error 
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function E(x) defined in eq. (j3.17|L and we need to calculate the following integral to 
obtain the explicit form of the AT condition of the RS2 solution 


I DzE n 




(A.43) 


Remembering the argument of E in the AT condition is \/q/( 1 — q)z and using eq. flA.Sp . 
we hnd that for z < 0 the function E goes to 1 and the integrand of eq. (1A.43|) becomes 


E r ' 


E" 

~E 


E' 

~E 


->■ 


Q 1 -A-- 

__, , - ze 21 ~i -e 

a/27t V 1 - q 27r 


(A.44) 


This contribution vanishes in a rapid manner for any n. Meanwhile, for z > 0 eq. (IA.43[) 
becomes 

4 i 1 (A45) 

which vanishes for n > 0 but a constant 2 remains if n = 0. Assuming 0 < n < 4, we 
obtain the AT condition in this limit as 


a 


4/o C 



(i -qY 


1/2 


2ea 7 


< 1 . 


(A.46) 


Recalling eq. (IA.6|) indicating q oc l/\/l — q, we can see that this condition is always 
satisfied for n > 0 but is violated on n = 0, which was already pointed out by Gardner [59]. 
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Appendix B 

Calculations for chapter 4 


B.l Derivation of the generating function <j)(n) and 
free energy of regular random graphs 

At first, we give the explicit form of the generating function (f>{n) for the fc-spin interacting 
regular random graph with coordination number c, since the derivation requires rather 
involved calculations. The generating function 0(n) is given by 

where 

h = 

h = 
h = 

The functions 7r(/q) and 7r(/q) are determined by the saddle-point, conditions. The saddle 
point conditions for tt and n yield 


(p (n) = i 0 g [Z n ]j/N = - log h - clog/ 2 + log J 3 , 


(B.l) 


(2oosh P J T (niJMW) [ 1 + tanh ^n‘ tauh/jfe 


2—1 


dhdh7r(h)-K(h) 


1 + tanh / 3h tanh /3h\ 




TTfjC^fCw ( 2 cosh 

W dhMh)) nT« 


(B.2) 

(B.3) 

(B.4) 


k-1 


7 r(h) = / W^dhiiiihi)) 


2=1 
, C— 1 


jfe -1 


6 | h — — tanh 1 (ta,nh /3J tanh /3hi) 


« c—1 / c—1 

7 r(h) oc j PJ(dhj7f(hj))5 ( h - ^hj 


2 cosh (3h 

nr l2c °sh^ 


(B.5) 

(B.6) 


These relations are identical to those of the cavity field h and bias h of BLs. Substituting 
solutions of eqs. (IB. of) and (IB. 611 to eq. (IB. IK . we obtain an explicit expression of 4>(n). 
Next, we turn to the derivation of eq. (ED 
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The first procedure is to calculate the number of possible configurations of a random 
graph. Let us define as a characteristic function which takes 1 when a coupling exists 
between a fc-spin combination /i = {4, Z 2 , • • • , 4} and 0 otherwise. The number of possible 
graphs is expressed by using a M as 


TV 


c=£IT £ 

{ a (T l— 1 V a M( 


a m c 


(B.7) 


where /i; = {/, Z 2 , ■ ■ ■ , 4}- This can be transformed as 


TV 




TV 


“m/ “ c 


(2^)^ J V^ C+ 1 


TV 

n 


exp *°S I 1 + -ii-'i •' 'XiJ h 


(B.8) 


where we used an identity 

j) dz\z n = 5 n , o, (B.9) 

for the first formula. We expand log (1 + z^z\ 2 ■ ■ ■ zi k ) and keep only the first-order term 
z^zi 2 ■ ■ ■ Zi k since higher-order terms correspond to multiple interactions for a combination 
/i. Hence, 


G = 



(B.10) 


We use an asymptotic formula k\ zi t zi 2 ■ ■ ■ Zi k ~ f°r large iV to introduce a 

variable g = (Y2iLi z i)/N- Expressing this constraint by a delta function and using the 
Fourier expression, we get 


G 




(B.ll) 


The integration with respect to Zi can be performed and eq. (IB.Ill) reads 


G 


q 


N k 


dqdqexp N log — — Nqq + —- q 
cl k\ 


(2ni) N 

The saddle-point method yields the asymptotic behavior of G as 

N k ~ l 


Q = 
1 


,fc-i 


JJ—i’ q = f 


rk—1 


c c N K 

jv i ogG= __ c+c i ogc+ _i og ____i ogd . 


(B.12) 


(B. 13) 
(B.14) 
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Secondly, we calculate [ Z n ]j. The expression using is given by 

- N 




exp 


{a M } 1=1 \ a M; / L \ M a=l 

Using the same transformation as eqs. (IB.7MIB.10p . we get 

N 


(B.15) 


[z n ]j = 


1 1 


n v s exp 


G{2m) 1 ' t J - L / J - V Tp/fS} 
We introduce the following transformation 






J J 




Z— 1 


(B.16) 


(B.17) 


where cr = ±1 denote the additional spin variable and S(a t , S^) is the indicator function 
which takes 1 when the spin variables cr* completely accord with Si t and 0 otherwise. 
This formula leads to 

k 




Zl2 ■ ■ ■ Z h 


N 




(B.18) 

i 




where 


Qi&i) a t y ] Z lfi(<Tj,Sl)- 


(B.19) 


(B.20) 


For each configuration cr, we impose the constraint (IB.20P by a delta function and in¬ 
troduce its Fourier expression by employing the conjugate variable Q(cr). The result 

is 

N 


[Z"}j = 


l l 


G (27t i) 


•52/ II ( dzi ^1) Jr | II (dQ(o-)dQ(o-; 


x 


exp | Tr O'er. | ^ x : - NQ(cr)j 


JV 1 


(B-21) 


+s it n m E " . 

z 

Performing spin trace with respect to S and integration with respect to zi , we get 

I 2 "]-' =5 / If (rfQ(^)rfQ(or)) 

cr 

x exp <( iVlog Tr(T ^ ((T) - iVTrQ(cr)Q(cr) + Tr ^ TTpQ^)) [e^ l (B.22) 

c {o-} /c! 11 L 
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The saddle-point method is again useful to evaluate this equation. Under the RS ansatz 
of the saddle-point, Q and Q are generally written in the form 


Q(a) = q / dlnr(h) 

a 

r> n 

Q(<j) = q dhn(h) J 


1 + tanh 0 ha c 


1 + tanh (3ha c 


(B.23) 


(B.24) 


Substituting these formulas to eq. (IB.221) . we can calculate all the terms in the argument 
of exponential. The result is 

i\rk k N k ^ ^ 

hTrlfW^*)) J = -rr1 k h, TV Q(S)Q(S) = qqh, Tr Q(S) = ?I 3 , 

{a} k\ - L .- L L k\ {er} {<t} 


where I\~h are defined in eqs. (1B.2D - (IB.41) . Then, eq. (IB.221) is rewritten as 


-log[Z"] J = Extr 


N‘ 


k -1 


{ k\ 


-q k h - qqh + clogg - logc! + log/ 3 > - — logG 


N 


Taking the saddle-point conditions with respect to q and g, we get 


qqh = c = 


N' 


k -1 


-A h, q = 


I\N 


k -1 \ 1 / k 


(B.25) 

(B.26) 

(B.27) 


(k-l)h ” " qh h \c(k-l)\ t 

Substituting these conditions and eq. (IB. 141) into eq. (IB.261) . we find that irrelevant con¬ 
stants are canceled out and obtain eq. (IB.II) . 

The free energy is easily obtained from eq. (IB.II) 

dcp RRGl 


n 


dn 


c T / 


n=0 


= = ^h - c h + 4 , 


where 


h = 


I 2 = 


h = 


~^(dhi7i(hi)) log J 2 cosh f3J 

i=l 

dhdhn^TT^h) log 

C 

~[(dhiTf(hi)) log 


1 + tanh f3 J tanh (3hi 


2 k+l 

1 + tanh f3h tanh (3h\ 




2 cosh (3 YPh 


i=1 


n-2cosh^ 


(B.28) 

(B.29) 

(B.30) 

(B.31) 


These distributions 7r(/i) and 7r(h) satisfy eqs. (IB. 51) and (IB.6j) in n = 0. Note that the 
first term in eq. (IB.28j) corresponds to the bond contribution (14.15)) and the second and 
third terms are the site contribution (I4.16p . which shows the correspondence between the 
free energy of an RRG / RRG and that of internal part of a BL fi in eq. (14.18)) . Although 
the second and third terms in eq. (IB.281) take different mathematical expressions, the 
saddle-point conditions with respect to 7r(/i) and i f(h) guarantee the accordance of these 
terms. 
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B.2 Location of replica zeros of the width-2 ladder 


We prove that all RZs of a 2 x L ladder lie on the line Irn(y) = n/2 for any L. We 
introduce the notation 

Pi(x)=pi ;0 = jj^, (B.32) 

di[x) 

where di and rti are polynomials of x = e y and ni(x)/di(x) is assumed to be irreducible. 
The outline of the proof is as follows. First we present the general solution of pi and 
show that the denominator di has 2F((/ + l)/2) roots which are all purely imaginary. The 
function F(l) is the floor function, which is defined to return the maximum integer i in 
the range i < l. Also, we show that the number of nontrivial solutions of S/ = 0 is equal 
to 2F((Z + l)/2) and Ei can be factorized as Ci(x)di(x), where Ci(x ) is a polynomial of 
x. From the correspondence of the numbers of the roots, we conclude that all the zeros 
of Ei are equivalent to the roots of di(x ) and Ci(x ) takes the form ax b . 

The iteration for pi (I4.64|) has a solvable form and its general solution is given by 


2(4' — h{x) 1 ) 

4 Z (2 + x 2 — xy/x 2 + 8) — (2 + x 2 + xy/x 2 + 8 )h(x) 1 ’ 


(B.33) 


where 


h(x ) 


—4 — x(x + yjx 2 T 8) 


X + yjx 2 + 8 
X — yj X 2 + 8 


The roots of the numerator in eq. (IB.331) can be easily calculated as 


f ±2 y/2i (/ = 2m + 1) 

\ 0, ±2y/2i (/ = 2m) 


(B.34) 


(B.35) 


where i denotes the imaginary unit and m is a natural number. Then, we concentrate on 
finding the roots of the denominator in eq. (IB.331) except for those of the numerator (IB.35j) . 
From numerical observations in sec. m we found that any of the roots x*, which satisfy 
Ei(x*) = 0, are purely imaginary and bounded by |x*| < 2y/2. Hence, we assume these 
conditions and perform the variable transformation z = — xi. Equating the denominator 
of eq. 0B.33j) to 0, we get 


h[—iz ) 


\/8 — z 2 + iz^ 2 — z 2 — iy/8 — 
\/8 ^^z 2 — iz ) 2 — z 2 + iy/8 — 


(B.36) 


We now enumerate the number of solutions under conditions that z is real and bounded 
as —2y/2 < z < 2yf2. Under these conditions, we can transform eq. (IB.36j) into a simple 
form by using the polar representation. The result is 


e i(20i-7r)z _ & ae 2 


(B.37) 


where y/8 — z 2 + iz = rie ldl (—n <6\<tt) and r 2 e* 02 = 2 — z 2 —iyj 8 — z 2 (—7r < 0 2 < tt). 
While z varies from — 2y/2 to 2y/2 continuously, the radius rq stays at a constant 2y/2 and 
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the argument 6 \ varies from — 7 t /2 to 7 t /2 in the positive direction. In the same situation, 
changes from +ir to —n in the negative direction. The radius r 2 is not constant, but 
is finite in this range. The variables Q\ and 62 are obviously continuous and monotonic 
functions of z. Therefore, the argument of the left-hand side of eq. (IB.37j) starts from 
9 = 0 and rotates with angle 21tt in the positive direction and the counterpart of the 
right-hand side varies from the same point 6 = 0 to — 47 t. This means that there are 
l + 1 values of z where the factor (26 , 1 (z) — 7 r)Z becomes equal to 2 9 2 (z) except for trivial 
solutions z = ±2\/2. When l is even, these solutions contain a trivial solution z = 0, 
which can also be confirmed from eq. (IB.331) . Hence, the number of nontrivial roots of di 
becomes l + 1 for odd l and l for even Z, which is equivalent to 2 F((l + l)/2). 

As already noted, the number of nontrivial solutions of 5; = 0 is equal to 2F((Z + l)/2). 
This can be understood by considering that the number of terms of [ Z n ]j is determined 
by the maximum number of defects rid- In the 2 x Z ladder case, the value of rid is given 
by F((l + l)/2) and the number of terms is rid + 1- The highest degree of the relevant 
polynomials for RZs comes from the difference between the highest and lowest ground- 
state energies and is given by 2 rid — 2 F((l + l)/2), which yields the number of nontrivial 
solutions of 5/ = 0 . 

Finally, we prove that 5/ takes the form Aix bl di(x ) by induction. From eqs. (I4.64j) and 
(I4.63P with the initial conditions p 0 . 0 = 0, S 0 = x, we derive 

Pl = Sl = \ x2(yX 2 + ^ B ' 38 ' ) 

which satisfies the desired form. Assuming that the condition S [ = Ax b ‘di(x ) is true for 
l = k, we substitute this expression into eq. (14.63P to get 


s ‘ +i - Axbtihx3 \j k + K i+ ?) 0 

= i Ax bk+1 { (x 2 - 1 )n k + (1 + x 2 )d k } . 
Equation (I4.64p can be written as 



(B.39) 


Pk+l 


dk flk 

(x 2 - 1 )n k + (1 + x 2 )d k 


W'k +1 
dk+i 


(B.40) 


which gives 


(x 2 - 1 )n k + (1 + x 2 )d k = c k+ i(x)d k+ i(x), 


(B.41) 


where c k +1 is a polynomial and satisfies c k +1 = (d k — rik)/n k +i. Substituting this relation, 
we can rewrite eq. (IB.39P as 


5 fc+ i = ^Ax bk+1 c k+ i(x)d k+1 (x ). (B.42) 

As we have already shown, the number of nontrivial zeros of is equal to that of d k +i- 
This means that c k +1 cannot have nontrivial roots and hence c k +1 takes the form Ax b . 
This completes the proof by induction and demonstrates our proposition that all RZs for 
the 2 x L ladder have a constant imaginary part i7r/2. 
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B.3 Rate function for a CT with c — 3 


We here calculate the generating function 4>l(v) for finite L. Consider an L-generation 
branch of a c = 3 CT. An explicit form 4>l{v) is easily derived from eq. (14.70P as 


2 l 2 l+1 1 
M x ) = TTFZi-7^0 + TTTZi- t( X * 2_L ) lo g x + 


2 l +i - 1 

where x = e y and 


2 L +! - 1 


4 - 2~ l+1 ^ 2 * 
i=o 


L-l 

E 


fog fi 


(B.43) 


= fog S 0 , fi = fi(x,pi- 0 ) = !--(!-x 2 )(l-p i;0 ) 2 , 


(B.44) 


using the same notations as in section 14.21 The rate function with finite generations L is 
given by 


R l (x) = 


2 l +i 


0 O — x log x 


dfjf o' 
dx 


1 \ i 

~jpz+\ Yj- ^ log ~ Ci ^ x log ’ 


(B.45) 


where the factor C,fx) is given by 


Ci{x) 


_df^dPi ,o + dfj 
dp^ dx dx 


(l-x- 2 )(l 



x 3 (l~Pi-o) 2 . 


(B.46) 


Let us denote Roo(x) = lim^oo Rl(x). Because the inequality R^ < 0 always holds, 
the 1RSB transition does not occur as long as the condition Roo(x) = R(x) is satisfied. 

In the range y > 0 yy 1 < x, the factor fi is bounded as 1/2 < fi < 1. This 
guarantees the uniform convergence of 4>l(x). The boundedness of ( dpi-o/dx ) can also 
be shown with some calculations. These conditions guarantee that Rl(x) converges to 
a function R^ uniformly. Hence, from elementary calculus, the equality R(x) = R 0Q (x) 
holds, which implies the absence of 1RSB. The same conclusion is more easily derived for 
a BL because f % does not depend on i. 


B.4 AT condition for the (&, c) = (2,3) Bethe lattice 

We derive the AT condition for a BL. Especially, we explain the case (k, c ) = (2, 3) in 
detail. The extension to general (k, c) is somewhat involved but straightforward. To 
evaluate P/g ^op we construct the transition matrix of our random-walk problem. For a 
given (h g , h g+ i), the posterior distribution of r g is given as 

p(r g \h g ) = p(r g ,h g )/p(h g ) oc e y{lrg+hgHrBHhsl) p(r g ), (B.47) 

where p(r g ) is the prior distribution of r g . This enables us to derive the concrete expression 
of p{r g \h g ), summarized in Table iBTl We can distinguish three states of the walker at 
the ( 7 -step as follows: 
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r 9 \ K 

1 

0 

-1 

1 

1 - pb 

1 - Pb 

(1 -p b )e~ 2y 

(1 + p b ) + (1 * p b )e~ 2 y 

2 

(1 + p b ) + (1 - Pb)e~ 2 y 

0 

2 p b 

Pb 

2 Pb 

(1 +p b ) + (1 - Pb)e~ 2 y 

(1 + p b ) + (1 - Pb)e~ 2 y 

-1 

(1 -Pb)e~ 2y 

1 ~Pb 

1 ~Pb 

(1 +p b ) + (1 — p b )e~ 2y 

2 

(1 +Pb) + (1 -Pb)e~ 2 y 


Table B.l: Values of p(r g \h g ) for (k, c ) = (2, 3). The symbol pi is the probability that the 
cavity bias takes the value 0 . 


11) : The walker has already vanished. 

12) : The walker survives and \h g \ = 1. 

13) : The walker survives and \h g \ =0. 

Hence, using the relation (14.921) . the transition matrix T can be written as 

/ 1 pi,i \pifl x 2 \ 

T= 0 p 0 ,i |pi , 0 x 2 , (B.48) 

\ 0 P- 1,1 Pop ) 

where P Tg b g represents p(r g \h g ) and the condition P Vg y Lg = P_ rg applies. When | h g + 
r g | = 1 and \h g \ = 0 , the states jl) and \2) occur with equal probability 1 / 2 , while \2) is 
always chosen when \h g + r g \ = 1 and \h g \ = 1. This is due to the correlation between h g 
and 5h g . To see this, let us consider the evolutional equations for biases and perturbations. 
Their explicit forms are 

h g -1 = sgn (j g 0lg + r g )^j , 

(-T _ dhg—l *> 

oh 0 _i — ——— oh a . 
dh g 

From eqs. (14.911) and (14.921) . we can obtain all possible values of h g -1 and dh g -i/dh g , 
and summarize the result under the condition J g — 1 in Tables IB.21 and IB.31 A no¬ 
tation q g (±\u) represents the conditional probability for sgn ^= ± under the con¬ 
dition h g = u. Comparing the Tables IB.21 and IB.31 we can find that when h g _i = 1, 
5h g _i = (dh g -i/dh g )5h g becomes never positive. Similarly, when h g -1 = —1 holds, 5h g -i 
is positive, ft is easy to see that these facts hold for J g = —1. Hence, an inequality 
h g _i • 8h g _i < 0 is necessarily required, which explains the transition rules between the 
states | 1 ) and \2). 

The matrix T has three eigenvalues: Ai = 1, A 2 , and A 3 . The eigenvector of the largest 
eigenvalue Ai = 1 corresponds to the state |1) or the vanishing state. Hence, the surviving 


(B.49) 

(B.50) 
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r g \ kg 

1 

0 

-1 

r g \ K 

1 

0 

-1 

1 

1 

1 

0 

1 

0 

0 (<7s(+|0)) 

1 (9»(-|0)) 

1 

0 

1 

0 

-1 

0 

0 (Qg(+ 1)) 

i M-|i)) 

1 

1 (9 S (+I - 1)) 

o (<&(— 1 - 1)) 

-1 

0 

-1 

-1 

-1 

i 

1 (9g(+|0)) 

0 («j(-|0)) 

0 


Table B.2: Values of h g _ i with J g = 1. Table B.3: Values and probabilities (q g (±\u)) of 

dh g _i/dhg with J g = 1. 


probability P( G _ > 0 ) is given by 1 — (1|G), where |G) is the state of the walker at the G 
step. For large G, the relevant state is of the second-largest eigenvalue A 2 , and we get 

P(G—>o) ~ Af. (B.51) 

Using the stationary solution (14.75)) . we obtain P( G ->.o) as a function of x = e y . The AT 
condition becomes 


Xsg oc - 1 ) G (c - 1 ) g P ( g ^ 0 ) -t oo (k - l)(c - 1)A 2 > 1. (B.52) 

G 


This condition is easily examined numerically and we can verify that the AT instability 
occurs at uat ~ 0.54397 for (fc, c) = (2, 3). 

Before closing this section, we give some brief comments on general (k, c ). For general 
c under the case k = 2, the evolution equation of the cavity bias becomes 


h g _ i = — tanh 1 [ tanh(/3 J g ) tanh 


j/3 + 


9,3 


c-1 


sgn J g + ^ - 


9,3 


{P ->■ oo) 


(B.53) 


j= 1 


This equation implies that the table IB.31 is modified and becomes a new table between 

Other discussions are almost the same as the case c = 3. Using 


h g and r g 


E C— 1 

7 = 1 


9,3' 


the notation p{r g \h g ) = p r ^ and the symmetry p r ^ = p_ r as the c = 3 case, the 
transition matrix T can be written as 


T = 


Y^ C r =lPr,l + Ylr= 2 P-r,l Ylr=2(Pr,0 + P-r,o) + |(Pl,0 + P-1,0 


P0,1 

P-1,1 


|(Pl ,0 +P-i,o) 
Po,o 


(B.54) 


Note that the term p_ 2j i in the second column is included in the transition rate from |2) 
to |1). This is because the inequality h g -\ ■ 5h g - 1 < 0 holds in the general c cases. The 
second largest eigenvalue A 2 of T determines the AT condition by (c — 1)A 2 = 1. 
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For the k = 3 case, the update rule of the cavity bias is 


i = — tanh 1 * ^tanh(/3 J g ) tanh (/3f g ) tanh <| (3 | 'h g + r g j 


c-1 


—y 


sgn ( J g f g ( h g + r 9d ) ) (Z 3 oo), ( B - 55 ) 

3 = i 


where f g denotes the cavity field coming from the other branch of the tree and r g again 
represents r g,j- Since the cavity field f g is uncorrelated with the biases (h g ,{r g j}), 
it is sufficient to consider the correlation among the biases (h g , {r SJ }) as eq. (IB.471) . This 
fact leads to a similar list to table IB. 31 Difference between the k = 2 and 3 cases appears 
in the transition matrix. According to eq. (IB. 5 51) . when the cavity field f g equals to 0, 
dhg_i/dh g becomes 0 and the walker vanishes independently of the values of [h gi {r 9J }). 
This yields the transition matrix as 

(1 1 - (1 -p f )(po,l +P-l,l) 1 - (1 -Pf) (§(pi,0 + P-i,o) +Po,o) \ 

T = I 0 (l-p/)po,i (l-P/)|(Pi,o+P-i,o) , (B.56) 

\0 (l-P/)P-i,i (l-P/)Po,o / 

where pj denotes the probability that the cavity field f g becomes C0. The second largest 
eigenvalue of this matrix A 2 again gives the AT condition by (3 — l)(c — 1)A2 = 1. 


1 For the ( k, c) = (3, 3) case, the probability pf is already given as the convergent solution of eq. (14.741) . 

or the solid line in fig. 14.161 
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Appendix C 

Calculations for chapter 5 


C.l Divergence point of the spin-glass susceptibility 
at zero temperature 

Our starting point is the self-consistent equation satisfied by the convergent CBD P(h) 
in the absence of the external field 

c— l 

pthi) = / n (AbO) 


c — 1 


h — — tanh 1 


tanh (3J tanh 1/3 h 



, (C.l) 


Analytical assessment of the solution of this equation is possible only at zero temperature 
as in appendix IB.41 which enables us to treat the problem in an analytical manner. 

The evolution equation of the cavity bias is given by 


V i 




— Itanli^ 1 {t m h(pj 3 )t,nh(f)(h g + r s ») 

sgn (j g (h g + (\hg + r g | > 1 ) ^ , 

J g (fig + r g ) ( otherwise ) 


(C.2) 


where J g denotes the coupling between sites g — 1 and g. This relation implies the cavity 
fields and biases become integers, because we are treating the ± J = 1 model. Hence, the 
general form of the CBD can be written as 


For the BL with c 


i 


P(h)= Y^VkKh-k). 

k=-1 

(C.3) 

ea. (10.1 ) is rewritten as 

Pi = p{pI + 2p 0 Pi) + (1 - p)(p 2 - 1 + 2p 0 P-i), 

(C.4) 

Po = Pi + 2pip_i, 

(C.5) 

P-i = p(p-1 + 2p 0 p-i) + (1 ~p)(p'i + 2popi). 

(C.6) 
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These equations have a ferromagnetic solution for 7/8 < p < 1, the explicit form of which 
is given by 


Pi = 

4p — 3 1 

/ 32p 2 - 52p + 21 

(C.7) 

2 (2p — 1) + 2\J 

(2p — l) 2 ’ 

Po = 

P-1 -- 

= l-p 1 -p 0 , 

\J 12p\ — 4pi + 1, 

(C.8) 

(C.9) 


and have another solution p_i — pi — p 0 — 1/3 for p < 7/8, which can be regarded as the 
RS spin-glass solution. 

Equations (1C.2ft and (1C.3|) means 



0 

0 or 1 
1 


( fig + r g\ > 1 ) 

( I kg + r g | = 1 ) ) 

( otherwise ) 


(C.10) 


where the value of 0 or 1 for the case of \h g + r g \ = 1 is determined depending on the 
value of h g . Equation (IC.lOp indicates that the assessment of eq. (I4.90P is analogous to an 
analysis of a random-walk which is bounded by absorbing walls. We denote by -P(g->o) the 


probability that 


of UU \dhg-i/dh g \ is kept to unity. This indicates that the critical condition at 
temperature becomes 


dh g -i/ dh g 


never vanishes during the walk from G to 0 and the value 


zero 


log(c - 1) + lim — logP (G ^ 0 ) = 0. 

G—>oo G 


(C.ll) 


To evaluate the surviving probability P(g-+ op let us formulate this random-walk prob¬ 
lem. Since we are now considering the case that the ferromagnetic bias exists, which is 
different from appendix IB.41 we should in principle distinguish the following seven states 
of the walker at the g-step: 


11): The walker has already vanished. 

|2±): The walker survives under the conditions h g = 1 and sgn {hh^j = ±. 

|3±): The walker survives under the conditions h g = —1 and sgn (bhg^J = ±. 

|4±): The walker survives under the conditions h g = 0 and sgn (shg^J = ±. 

These seven states, however, can be reduced to four states by considering the relation 

hg _i • 5h g -1 < 0 which can be derived by the same discussions as in appendix IB. 41 As a 
result, the state |2±) and |3±) are reduced to \2) = \2—) and |3) = |3+), respectively. 
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On the other hand, when h g - \ = 0 the sign of Sh g does not change with probability p or 
change with probability 1 — p, which leads to the following equations 


?s-i(+l°) = PQg(+ 1°) + (! “ P)9</(-|0), ( C - 12 ) 

9<7-i(-|°) =PQg(~ 1 °) + ( 1 “P)9 S (+|0)> (C.13) 


where q g [P\u) represents the conditional probability for sgn ySh g j = ± under the con¬ 
dition h g = u, which is the same notation as appendix IB.dl Under the assumption that 
the initial perturbation is completely random, we find that g 9 (±|0) equals to 1/2 for \/g. 
Because of this symmetry, we need not to distinguish the states |4±) and hereafter write 
as |4). Considering the above discussions and using the relation (IC.lOp . we can write the 
transition matrix T of the walker as 


(1 

Pi 

P -1 

| (pi +p-i) 

\ 

0 

PPo 

1 

O 

\ (PPi + (1 ~ P)P- 1 ) 


0 

(1 - P)P0 

PPo 

| (PP- 1 + (1 - p)Pl) 


\0 

P -1 

Pi 

Po 

) 


(C.14) 


where T t] denotes the transition probability from | j) to \i). When \r g \ = 1 and h g = 0, 
the probability flow from |4) to |1) exists with the weight 1/2 while there is no such flow 
when r g = 0 and \h g \ = 1. This is the consequence from the above considerations. This 
matrix has four eigenvalues Ai = 1, A 2 , A 3 and A 4 . The eigenvector of the largest eigenvalue 
Ai = 1 corresponds to the state |1) or the vanishing state. Hence, the surviving probability 
P (G— > 0 ) is given by 1 — {l\g = 0), where \g = 0) is the state of the walker at the g = 0 step. 
For large G, the relevant state is of the second-largest eigenvalue A 2 and P[G —> 0) oc Xf, 
which leads to the critical condition 


(c — 1)A 2 = 1. (C.15) 

For c = 3, this condition is easily examined by using eqs. (1C.71) - (1C.91) and (1C.141) . The 
resultant transition point is p = 0.92067, which well agrees with the results given in the 
main text. 
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